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Synopsis 


This thesis addresses itself to the problem of optimal random access algorithm 
tor a finite user model More specifically, we study a class of random access 
algorithms known as the blocked random access algorithms Consequently, 
we focus only on the collision resolution aspect of a random access algorithm 

In recent times, there has been a considerable interest in the study ol 
random multiple access (or simply random access) communication systems 
due to the widespread use of computer communication networks In random 
access communication, there are many sources of bursty data traffic (called 
users) which send messages through a common broadcast communication 
channel In this thesis, we consider the random access systems which can be 
modelled by what is called the Common Receiver Model In a common receiver 
model, multiple users send messages to a single receiver The common 
receiver model can, in fact, be considered as an instance of random access 
communication and after taking propagation delay into account, the random 
access communication model can be considered as the superpositon of several 
such common receiver models For our purposes, it suffices to focus on the 
common receiver model The signal received at the receiver may be corrupted 
due to possible simultaneous transmission of messages This interference is 
called collision. The collided messages require retransmission The random 
access problem deals with the efficient scheduling of theses messages and 
the scheduling strategies that the users (with bursty traffic) follow are called 
random access algorithms or protocols 

In general, the multiple access problem is concerned with using a common 
broadcast communication channel by many users This problem has also been 
considered within the framework of information theory [9] In random acces' 
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communication the emphasis is on the bursty arrival of messages Another 
important difference is that m random access communication, the channel 
noise IS Ignored thus decoupling the random access communication problem 
from the standard communication problems studied m Shannon's sense 

The ma)or parameters that are of interest for characterizing the efficiency 
of any random access algorithm are throughput, delay and the stability of 
the system The messages are assumed to be broken up into segments called 
packets In our study, the operation of the system is assumed to be time 
slotted Thus the users can transmit their packets only at the beginning of 
a slot It IS also assumed that the users receive ternary valued feedback at 
the end of each slot This feedback is represented by 0, 1 or 2 depending 
upon whether the slot contained no packet, one packet or more than packet 
respectively Two models of user population have been considered in the 
literature In Infinite User Model, there are infinite number of users and the 
aggregate traffic of the packets generated by all users forms a Poisson process 
In Finite User Model, there is a fixed set of finite users and each user generates 
packets independent of each other We consider the finite user model for our 
study 

Beginning with the development of ALOHA [1], there has been an explosion 
in proposing random access algorithms, each claiming better throughput than 
the previous one Though the work of Capetanakis [7], Massey [44], Gallager 
[16], Pippenger [56], Molle [50] and Tsybakov [78] substantially improved 
the understanding of random access algorithms, however, as pointed out by 
Massey [43], the concern for proposing ever new algorithms has sometimes lead 
to wrong comparisons between various schemes that in fact require different 
channel models Thus most of the studies in random access communication are 
not directed towards developing a general theory of random access algorithms 
This may be, in part, due to the ever increasing pressure of network designei 
community to come up with practically useful protocols One of the ma )0 
contributions towards developing a theory of random access algorithms wa 
made by Tsybakov [74], who looked at the structure of the information patten 
available to the users for taking decisions and gave a formal notion of a randon 
access algorithm for the infinite user model 
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Tsybakov's work provides a mathematical framework for the study of ran- 
dom access algorithms for the infinite user model This gives us the motivation 
to investigate whether a systematic formulation of optimal random access al- 
gorithm for the finite user model can be given Such a formulation is not only 
desirable for the completeness of the theory but also can provide a framework 
for comparing different algorithms and establish their interrelationships One 
of the important conclusions of the thesis is that an optimal algorithm for a 
class ot random access algorithms can be (and has been) derived under a set 
of not quite unrealistic assumptions We summarize some contributions of this 
thesis in the following 


Main Results 

This thesis has been organized in to seven chapters In Chapter 1, we give an 
introduction of random access problem and a brief historical view of random 
access algorithms 

Following Tsybakov's work [78, 80], Chapter 2 is an attempt towards de- 
veloping an unified framework for the study of random access algorithms 
Accordingly, we give a systematic treatment of some random access algorithms 
within this framework We consider the random access systems which can 
be modelled by the common receiver model and discuss this model in de- 
tail We show how different random access algorithms can be classified using 
Tsybakov's definition We then discuss various performance measures like 
delay, throughput, stability, backlog and average collision resolution lengths 
considered in the literature The issues related to the capacity of a random 
access channel and an optimal algorithm are reviewed We then discuss the 
operations of some random access algorithms for the infinite user model The 
finite user model is considered next Tsybakov's definition of random access 
algorithm for the infinite user model enables us to define a random access 
algorithm for the finite user model We provide a classification of random 
access algorithms according to this definition and briefly review some of the 
existing algorithms which can be considered to be members of a particular class 
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of algorithms Finally, we consider random access systems with multipackel 
reception capability This study is motivated by the fact that such channels 
can model code division multiple access (CDMA) systems [60] whose practical 
usefulness in packet radio networks has been demonstrated [82] A class ol 
such systems can be shown to be a generalization of the common receivei 
model We therefore consider this generalized model and provide a briel 
sketch of the recent progress made in the study of random access algorithms 
for this model 

We then focus our attention on a particular class of random access algorithms 
for the finite user model Our interest in this class is motivated by Tsybakov's 
appealing conjecture that an optimal algorithm over this class is also optimal 
over the entire class for the infinite user model Another interesting aspect 
of the algorithms of this class is that they can be shown to consist of a 
channel access algorithm and a collision resolution algorithm The channel 
access algorithm specifies the slot for the first time transmission of a newly 
generated packet, while the collision resolution algorithm is a strategy that 
the users follow to resolve the collision of their packets, if any. We assume 
the channel access to be the blocked access The operation of the system can 
then be divided into successive transmission intervals called collision resolution 
epochs 

In Chapter 3, we consider the problem of an optimal collision resolution 
algorithm for the finite user model To begin with, we assume that the 
number of active users at the beginning of a collision resolution epoch is 
known Furthermore, the users can transmit only one packet per epoch We 
identify an appropriate state of the system and control variables that constitute 
a Markovian Decision Process and show that the problem of optimal collision 
resolution algorithm is equivalent to the first passage problem of this Markovian 
Decision Process The dynamic programming technique is then applied to 
derive an optimal collision resolution policy The algorithm is illustrated with 
numerical examples Finally, we present the steady state operation of oui 
system using this collision resolution algorithm and suggest an approximate 
way to calculate the average collision resolution length 
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VI 


We then remove the restriction of the number of active users at the be- 
ginning to be known and consider a more general model in Chapter 4 Thus 
instead of the state being known exactly, we assume that the probability distri- 
bution over the initial states is given The conditional probability vector can be 
updated using the past control action and the feedback observed at each stage 
It is shown that this conditional probability vector constitutes the appropriate 
new state and the problem of optimal collision resolution can be considered 
within the framework of Partially Observable Markovian Decision Process The 
implementation of this optimal algorithm is, however, computationally bui- 
densome and hence we look for reasonably good suboptimal algorithms We 
suggest two suboptimal algorithms One is based upon choosing the control 
corresponding to the state which has the maximum value of probability, while 
the other is based upon choosing the control corresponding to the expected 
state as if these were the actual state The performance of these algorithms 
IS studied by simulations with different initial probability distributions These 
probability distributions are chosen to represent a range of users from lightly 
loaded to heavily loaded The expected collision resolution length is then 
compared with a bound on the optimum performance for each initial prob- 
ability distribution The degradation in performance for the two suboptimal 
algorithms is not very significant We then discuss the performance of these 
algorithms in the presence of feedback error by simulations 

In Chapter 5, we consider the case of users with infinite buffers For such 
buffered users, we consider an access protocol which employs the optinral 
collision resolution algorithm for the case of single buffer The head of the 
line packet of each active user participates in the collision resolution process 
usmg the collision resolution algorithm As soon as any of these packets is 
transmitted successfully, the collision resolution algorithm is interrupted and 
those other packets of the successful user which were generated in the previous 
epoch are transmitted in consecutive slots The user signals the end of the 
transmission of packets by an empty slot The algorithm then again starts 
from the point where it was interrupted We perform the steady state analysis 
of this protocol The sequence of transmission epoch lengths is shown to be a 
Markov chain The expressions for evaluating the state transition probabilities, 
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the steady state probabilities and the expected transmission epoch lengths are 
derived This protocol is compared with TDMA scheme in terms of throughput 
and another measure of performance called resolution factor which we have 
suggested The average packet delay analysis is then performed It is shown 
that the packet delay consists of three components The expressions foi 
evaluating each of these components have been derived The values of packet 
delays evaluated numerically for different arrival probabilities for a fixed set 
of users are presented We then consider a type of polling protocol and 
perform a similar analysis for this protocol This protocol is in fact a variant ol 
TDMA for buffered user The two protocols are compared with respect to the 
expected packet delay and the superiority of the protocol employing collision 
resolution algorithm is demonstrated 

Finally in Chapter 6, we study random access systems with multipackel 
reception capabilities We consider a generalized common receiver model with 
transmitter based code assignment Each transmitter is piovided with a set 
of orthogonal codes The number of such codes is much smaller than the 
total number of users in the system Each user, before transmitting its packet, 
selects one of these codes as its address and then encodes its packet with this 
address If two or more users choose the same code, then their packets collide 
We extend the formulation of the optimal collision resolution algorithm to such 
systems The collision resolution algorithm specifies the number of users to 
be enabled for each code The dynamic programming equations are solved 
to derive an optimal algorithm The algorithm is illustrated with numerical 
examples 

In Chapter 7, we summarize important conclusions of the thesis and indicate 
some directions for future research 
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Chapter 1 
Introduction 


1.1 Random Multiple Access Problem 

In the last two decades, there has been an explosion of research in the area ol 
random access communication Beginning with the development of ALOHA 
in 1970, the use of computer communication networks has become widespread 
and with that, the interest in the study of random access communication has 
also intensified In random access communication, there are many sources ol 
data traffic (called users) trying to send bursty messages through a common 
broadcast communication channel This system is modelled by what is called 
the common receiver model This model is discussed in detail in Chapter 2 

In a common receiver model, many bursty transmitters attempt to send 
messages to a single receiver The signal received at the receiver may be 
corrupted by mutual interference due to possible simultaneous transmission 
of messages This mutual mterference is called collision and usually results in 
loss of messages The collided messages thus require retransmissions in order 
to be received successfully at the common receiver The random multiple access 
problem is the efficient scheduhng of these messages by the users operating 
independently and m a decentralized manner and, the scheduhng strategies that 
the users follow are called random access algorithms (RAA) or protocols 

In general, the multiple access problem is concerned with using a common 
communication channel by many users This problem has also been considered 
within the framework of information theory A good account of this view 
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(known as multiuser information theory) can be found in the text by Covei 
and Thomas [9] Gallager [17] has reviewed these two approaches in terms oi 
the underlying communication problems 

The key difference between the two approaches is that in random access 
communication, the emphasis is on the bursty arrivaP of messages as opposed 
to uniform regular arrival of messages assumed in multiuser information theory 
approach Another important difference is that in random access approach, the 
channel noise is ignored The only form of error present on the channel is the 
destructive interference due to simultaneous transmission of messages The 
assumption of ignoring the channel noise in effect, decouples the random mul- 
tiple access problem from the standard communications problem consideied 
in Shannon's sense 

Although the notion of bursty arrival of messages is central to the study 
of random access system and the term bursty has been repeatedly used 
in the literature, there appears to be no systematic investigations in the 
characterization of the burstmess of a traffic arrival process The generally 
understood definition of burstmess is that when the peak arrival rate to the 
average arrival rate of a user's traffic is high, then that tiaf&c is considered 
bursty Thus m a multi-user environment, a user may not have anything to 
transmit most of the time and generates messages in the form of bursts This 
situation is encountered in computer networks like local area networks and 
packet radio networks Lam [39] mtroduces the concept of "bursty factor" 
to characterize a bursty source Berger [2]^ assumes that each burst can be 
encoded m the form of packets which may be either of fixed length or ol 
variable length 

In most of the studies conducted in random access communication, an 
infinite user model is considered In this model it is assumed that theie are 
potentially infinite number of users The total traffic of new packets generated 
by all users forms a Poisson process In a finite user model considered in the 

’Some studies consider that a user generates packets while others take the view that packd-' 
arrive to the buffer of a user In this thesis, the terms generation and arrival have been used 
interchangeablv 

^Se( [17] also 
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literature, it is assumed that there is a set of finite users and the packet arrival 
process to each user is assumed to be a discrete time random process ^ We 
will discuss this mode] in greater detail in Chapter 2 

In such a bursty user environment, the fixed assignment multiple access 
schemes like Time Division Multiple Access (TDMA) and Frequency Division 
Multiple Access (FDMA) prove highly inefficient The disadvantage of using 
these fixed assignment techniques in such situations is that the communication 
channel is wasted during the period when the assigned user has nothing to 
transmit while the user having a message to transmit may incur large delays 
In such situations, random access algorithms can lead to efficient channel 
utilization 

The major parameters that are of interest for evaluating the performance ot 
any random access algorithm are throughput, delay and stability of the system 
Various definitions have been used in the literature for these parameters [74] 
As established in [79], some can be shown to be equivalent definitions, bul 
others are wholly unrelated These definitions are discussed in Chapter 2 The 
different definitions have sometimes resulted in confusion leading to wrong 
comparisons of the protocols However, broadly speaking, we may define 
throughput as the expected number of packets successfully transmitted per 
unit time The packet delay is defined as the duration from the moment 
of Its generation to the moment of its successful transmission There are 
various other interpretations of delay which are discussed in the next chapter 
Generally, a random access system is said to be stable for a given arrival rate 
of packets, if the corresponding expected packet delay is bounded 

1.2 Historical Perspective of Random Access 
Communications 

The concern of a communication engineer is to determine the channel 
capacity or its limit to transmit information reliably and then design commu- 
nication protocols whose performance may approach this limit As mentioned 


■^Usualh this process is a Bernoulli process 
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by Massey [43], historically however, communication strategies have been sug- 
gested first before the actual modelling and the systematic study of the channel 
The study of random access communication also started with the development 
of ALOHA network in 1970 by Abramson [1] The objective of this networl- 
was to connect computer terminals situated at different locations of the Uni- 
versity of Hawaii through a radio link The development of ALOHA algorithm 
soon triggered research in random access algorithms Later on, Capetanakis 
and Tsybakov suggested stable random access algorithms which perform bettci 
than ALOHA algorithm Subsequently, several algorithms [44, 80, 16, 51, 83| 
were proposed each claiming better throughput than the previous one On 
this explosion of research in suggesting protocols, Massey wrote in [43] 

my far from exhaustive collection of payers on this subject now forms 
a pile about one meter high, most of which dates from the past five years 
There has, however, been scant attention given to channel models for 
random access communications This makes for confusion, throughputs 
are often compared for schemes that in fact require different channel models 

Although several algorithms were proposed, most of these studies lacked a 
systematic attempt to develop a general theory of random access algorithms 
Tsybakov looked at the structure of the mformation pattern available to the 
users and defined a class of random access algorithms by giving a formal 
notion of a random access algorithm Pippenger [56] considered the question 
of maximum achievable throughput for a random access channel and obtained 
an upper bound on this limit We briefly look at some of these historical 
developments in the following 

In the original ALOHA algorithm,'* if a user has a packet at any instant, 
it IS allowed to transmit this packet If two or more users attempt to send 
their packets simultaneously, a collision is said to occur and the packets are 
destroyed The unsuccessful users retransmit their packets after waiting for 
a random amount of time For the analysis of this algorithm, Abramson 
introduced the concept of statistical equilibrium similar to Kleinrock's inde- 
pendence assumption made in queueing theory [37] For a Poisson arrival 

••Also called Pure ALOHA 
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mode] of traffic, he assumed that the system ultimately reaches an equilibrium 
position such that the retransmission traffic adds to the incoming new traffic in 
such a way that the aggregate traffic remains Poisson Abramson showed that 
throughput T {t e , the expected number of packets successfully transmitted 
per unit time) can be expressed as a function of the total offered traffic C 
by the relationship T = Thus the maximum throughput that can be 

achieved with Pure ALOHA is l/2e or 0 18 packet/slot 

It was subsequently shown by Roberts [63] that this maximum throughput 
IS doubled, if the channel is divided into time slots and the packets are allowed 
to begin their transmissions only at the slot beginnings The length of each 
slot IS assumed to be equal to the packet transmission time At the end ot each 
slot, the users are informed about the state of the slot, i e , whether the slot 
was empty, contained one packet or contained more than one packet The slot 
containing one packet is called success slot and that with more than one packet 
IS called collision slot This model is called infinite user ternary feedback model (oi 
simply infinite user model) We will discuss more about this model in Chapter 
2 With these assumptions, the relationship between the throughput and the 
total offered traffic is given by T = Ge~^ which shows that the maximum 
throughput in slotted ALOHA is 0 36 packet^slot 

Two methods of scheduling retransmission of collided packets have been 
considered in the literature [40] In a geometrically distributed delay, the 
collided packet is retransmitted in a slot with some probability In a uniformly 
distributed delay, the collided packet selects a time slot for retransmission from 
some fixed time slots m equally likely manner 

After the introduction of ALOHA algorithm, several attempts were made 
to rigorously model and analyze the random access channel, with the result 
that Abramson's assumption of statistical equilibrium was soon found to be 
erroneous [38, 19] Markov chain formulation of the slotted ALOHA channel 
showed that the algorithm is unstable for the infinite user model Kleinrock 
and Lam [38] have discussed the stability of the ALOHA algorithm Then 
simulation results suggest that the channel becomes unstable independently ol 
the arrival rate of packets if the number of users is very large The instability 
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was said to occur when the number of blocked packets (te , those waiting 
for retransmission) becomes arbitrarily large For a finite user model, it was 
established that the slotted ALOHA algorithm can be either stable or unstable 
depending upon the number of users and the trafftc arrival rate [33] 

Various control schemes [34, 62, 28, 72, 67] have been suggested to improve 
the stability of the ALOHA algorithm These control schemes are essentially 
based on two policies 

• Making the retransmission probability dependent on the state of the 
system 

• Limiting the access of newly generated packets to the network 

The former is called the retransmission control policy [41, 19] and the lattei, 
the input control policy [49] 

Note that the ALOHA algorithm, even with control schemes, can give a 
maximum throughput of 0 36 packet/slot only During the early seventies, 
it was not clear whether algorithms with higher throughput can be devel- 
oped A major breakthrough in the study of random access algorithms was, 
however, provided by Capetanakis [7] and independently by Tsybakov [81] 
They showed that their algorithms not only give higher throughput than 
ALOHA, but are mherently stable Capetanakis algorithm is known as the 
Binary Tree algorithm while Tsybakov introduced the same algorithm using 
the interpretation of a stack operation This algorithm is therefore called Stack 
algorithm 

The key concept behind Capetanakis's tree algorithm is that, unhke in 
slotted ALOHA with control algorithm, it is possible for the collided users to 
make use of the past history of feedback outputs and schedule their packets in 
a cooperative manner so as to retransmit them successfully [44] Such strategies 
are also called Colltston Resolution Algorithms The origmal tree algorithm is 
based upon the idea of tossing a fair com and dividing the collided users into 
two parts Those users who flip head retransmit in the very next slot and those 
who flip tail wait till any possible collision of the first group has been resolved 
after which they transmit in the next slot No new packets are transmitted 
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till the initial contending users have resolved their collisions 

Massey [44] proposed a modification to this algorithm to remove certain 
redundant operations performed by the algorithm The algorithm was latei 
improved by Gallager [16] who has given a Markov chain analysis for the 
infinite user model [18] This algorithm was independently proposed and 
analyzed by Tsybakov and Mikhailov m [80] Tsybakov's analysis is mori' 
powerful in the sense that it readily adapts to situations where users may 
toss a biased coin It is also elegant as it provides recursive expressions foi 
calculating the throughput of the algorithm 

The original tree algorithm of Capetanakis assumed blocked channel access for 
Its operahon, where the new packets are blocked till the colliding packets have 
been resolved This algorithm therefore calls for the continuous monitoring 
of channel by the packets Tsybakov and Vvedenskaya [81] considered a fiee 
access stack algorithm in which, unlike in the blocked access tree algorithm, 
a newly generated packet does not wait for contending users to resolve their 
collisions but is immediately transmitted in the next slot It then joins the 
group of the contending users if unable to transmit successfully in that slot 
Thus the algorithm requires that a packet monitor the state of the channel only 
in the period from the moment of its initial transmission till the moment of its 
successful transmission Tsybakov showed that such an algorithm is indeed 
stable and achieves a throughput of 0 384 packet/slot It was subsequently 
recognized [22] that such algorithms belong to a class of algorithms known as 
the Limited Sensing Algorithms 

For the infinite user model, Massey's modified tree algorithm gives a 
throughput of 0 375 packet/slot and 0 462 packet/slot for blocked channel 
access and window channel access respectively while Gallager's algorithm 
gives a throughput of 0 48 packet/slot 

The packet delay analysis of these stack/tree algorithms has proved to be 
an extremely formidable task Various attempts [7, 44, 14, 20, 31] have been 
made to perform the delay analysis Most of these studies, however, obtain 
only upper and lower bounds on the expected packet delay 

It was Pippenger [56] who first addressed the question of maximum achiev- 
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able throughput for a random access channel This maximum possible through- 
put IS called capacity of the random access channel This brought in the notion 
of an optimal random access algorithm He showed that the capacity of an 
infinite user (ternary feedback) model of random access channel cannot be 
greater than 0 744 packet/slot 

The bound on the maximum throughput was further tightened by Molle 
[50] and, Cruz and Hajek [10] to 0 673 and 0 612 respectively The best known 
upper bound due to Tsybakov and Likhanov [77] is 0 568 Vvedenskaya and 
Pinsker [83] have considered a class of random access algorithms known as first 
come first served (FCFS) algorithms They have derived an optimal algorithm 
which achieves capacity on the subclass of these FCFS algorithms 

The key observation made by Pippenger [56] is that there is an uncertainty 
about the location of packets on the generation time axis and the objective 
of any random access algorithm or protocol is to resolve this uncertainty 
in order to transmit packets successfully The protocol can gam one bit ol 
more information by way of collisions and empty slots than by successful 
slots, meaning thereby that the protocol gains more information from failures 
than from success The bound on the maximum throughput reflects the 
trade-off between the twin objectives of transmitting a packet successfully on 
the one hand and gaming information by way of collisions and empty slots 
(in order to transmit packets successfully at later stages) on the other hand 
Another important conclusion of Pippenger's argument is that if the collision 
multiplicity IS known at the end of each slot, then throughput arbitrarily close 
to one can be achieved Panwar [55] has shown recently that it is indeed 
possible to derive such an optimal random access algorithm which in the limit 
can achieve a throughput of one 

Apart from the ternary feedback model, random access systems with binary 
feedback have also been considered [3] Generally, three types of binary feed- 
back have been considered They are collision/no-collision, somethmg/nothing 
and success/failure feedbacks Berger and Mehravari [3] have discussed the 
random access algorithms for these models 

For a finite population model, Capetanakis has considered the tree algorithm 
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with deterministic addressing [6] When the probability of each user having a 
packet IS known, then Capetanakis's proposal yields an optimum tree protocol 
This optimum tree protocol (called Dynamic Tree Algorithm in [6]) can be 
shown to be a generalization of TDMA 

The group testing algorithms considered m statistics [69] were also propioseci 
for the finite user random access model [85] The group testing algorithms 
which perform better than binary tree search algorithm of Capetanakis have 
been studied for both ternary and binary feedback models [4] 

In all the above studies, it has been assumed that if more than one 
packet IS transmitted in a slot, then collision occurs and all the packets are 
completely destroyed Recently a more general model has been considered, 
wherein the simultaneous transmission of two or more packets does not 
necessarily result in the destruction of all packets There are many such 
random access channels such as code division multiple access (CDMA) [60], 
packet radio network with capture effects [8] and multichannel networks [86] 
The first such study in the context of CDMA was made by Raychaudhuri [60] 
This study suggests that appropriate use of multiaccess coding can provide 
normalized throughput-delay characteristics better than that of ALOHA A 
recursive retransmission control strategy for slow frequency hopped-random 
access system was suggested by Hajek [27] One advantage of CDMA is that il 
can be used in asynchronous environment The throughput in asynchronous 
CDMA random access system with ALOHA has been investigated by several 
authors [52, 12, 35, 87] Ghez et al [24, 25] have studied a general model for 
an infinite user random access channel with multipacket reception capability 

Mehravari [47] has investigated collision resolution algorithms for a mul- 
tipacket reception model where if more than d packets (where d > 2) are 
transmitted, they are destroyed but the simultaneous transmission of d or 
fewer packets result in success We will review some of these results in the 
next chapter Collision resolution algorithms for random access CDMA systems 
were also investigated by Hu and Chang [30] 

Other studies made in random access communications are those of multiple 
access algorithms like Carrier Sense Multiple Access (CSMA), CSMA with 
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Collision Detection (CSMA/CD) and reservation protocols These and several 
other algorithms for packet radio networks have been discussed m the text by 
Bertsekas and Gallager [18] 

1.3 Motivation for the Thesis 

A large number of random access algorithms have been proposed in the 
literature Most of these algorithms have been studied for an infinite user 
model Some of the pioneering contributions in this area have been made by 
Capetanakis [7], Gallager [16], Tsybakov and his group [81, 80], Pippenger [56 j 
and Molle [50] Pippenger's seminal paper has given an insight into the nature 
of operation of a protocol, while Tsybakov's formal definition of a random 
access algorithm showed that many previously proposed algorithms can be 
studied within this definition Tsybakov and his group have provided some 
useful research directions towards formulating the optimal algorithms [74] 
Despite all these significant contributions, there are still some open questions 
in the analysis of random access algorithms and the issue of optimality ol 
these algorithms is far from settled 

On the other hand, the finite user population model has not been studied 
to that extent After Capetanakis's paper [6], Berger et al [4] have made some 
useful progress by proposing the application of group testing algorithms in 
random access context 

This provides us the motivation to take up the study of optimal random 
access algorithm for a finite user model The objective of this thesis is to inves- 
tigate whether a systematic formulation of optimal random access algorithm 
can be given The motivation behind this is that such a formulation is not 
only desirable for the completeness of the theory but also can provide a basis 
for comparisons of different algorithms and establish their interrelationship 

Sometimes, it may not be possible to derive an optimal algorithm but 
the approach adopted and the difficulty encountered thereby in obtaining 
an optimal algorithm may give us some clues to suggest good subophmal 
algorithms Indeed as will be shown in Chapters 3 and 4, we have derived. 
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under certain assumptions, an optimal collision resolution algorithm for a class 
of random access models When these assumptions are relaxed, we show 
the difficulty in obtaining an optimal algorithm and suggest two suboptima I 
algorithms Our claims about these algorithms are substantiated by simulations 

The steady state analysis under dynamic operation of this algorithm foi 
buffered users is then carried out Finally, the algorithm is extended to 
channels with multipacket reception capability This extension is motivated by 
the fact that such channels can model coded random access systems whose 
practical usefulness in packet radio networks has been demonstrated recently 
[82] 

We now summarize the important contributions and organization of the 
thesis in the following section 

1.4 Contributions and Organization of the Thesis 

In Chapter 2, we give a systematic treatment of some random access algorithms 
within Tsybakov's formulation We consider here random access systems which 
can be modelled by the common receiver model We discuss this model in 
detail The definition of a random access algorithm for an infinite user model 
provides a generic framework for the study of these algorithms We show how 
various random access algorithms can be classified using this definition We 
then discuss various performance measures hke delay, throughput, stability, 
backlog and average collision resolution lengths considered in the literature 
The issues related to the capacity of a random access channel and an ophmal 
algorithm are reviewed We then discuss the operations of some random access 
algorithms for the infinite user model The finite user model is considered next 
Tsybakov's definition of random access algorithm for the infinite user model 
enables us to define a random access algorithm for the finite user model We 
provide a classification of random access algorithms according to this definition 
and then consider our attention to a particular class of these algorithms We 
briefly review some of the existing algorithms which can be considered to 
be members of this class Finally, we consider random access systems with 
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mullipacket reception capability A class of such systems can be shown to be 
a generalization of the common receiver model We therefore consider this 
generalized model and provide a brief sketch of the recent progress made in 
the study of random access algorithms for this model 

In Chapter 3, we introduce the assumptions made for our finite user random 
access system We consider a class of random access algorithms for this model 
known as blocked random access algorithms The blocked random acces‘> 
algorithms are characterized by a collision resolution algorithm with blocked 
channel access We consider the problem of an optimal collision resolution 
algorithm for this model To begin with, we assume in this chapter thal 
the number of active users at the beginning of a collision resolution epoch 
IS known We also assume that the users can transmit only single packet 
per epoch We identify an appropriate state of the system and show that 
the problem of optimal collision resolution algorithm is equivalent to the first 
passage problem of a Markovian Decision Process The dynamic programming 
technique is then applied to derive an optimal collision resolution policy The 
algorithm is illustrated with numerical examples Finally, we present the 
steady state operation of our system using this collision resolution algorithm 
and suggest an approximate way to calculate the average collision resolution 
length 

In Chapter 4, we remove the restriction of the number of active users at the 
beginning to be known and consider a more general model Thus instead ol 
the state being known exactly, we assume that the probability distribution over 
the initial states is given The conditional probability vector can be updated 
usmg the past control action and the feedback observed at each stage It 
IS shown that this conditional probability vector constitutes the appropriate 
new state and the problem of optimal collision resolution can be considered 
within the framework of Partially Observable Markovian Decision process The 
solution of this problem is, however, computationally tedious Hence, instead 
of determining the optimal algorithm, we suggest two suboptimal algorithms 
One IS based upon choosing the control corresponding to the state which ha*' 
the maximum value of probability, while the other is based upon choosing the 
control corresponding to the expected state as if these were the actual states 
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The performance of these algorithms is studied by simulations The expected 
collision resolution lengths obtained from simulations for different probability 
distribution due to the two suboptimal algorithms is then compared with 
bounds on the optimum performance The degradation in performance due 
to the two suboptimal algorithms is not very significant for most cases We 
then discuss the performance of these algorithms m the presence of feedback 
error by simulations 

In Chapter 5, we consider the case of users with inhnite buffers For such 
buffered users, we consider an access protocol which employs the optimal 
collision resolution algorithm of Chapter 3 for the case of single buffer We 
perform the steady state analysis of this protocol The sequence of transmission 
epoch lengths is shown to be a Markov chain The expressions for evaluating 
the state transition probabilities, steady state probabilities and the expected 
transmission epoch lengths are derived The average packet delay analysis 
IS then performed Numerical results for different arrival probabilities foi a 
fixed set of users are presented We then consider a type of polling protocol 
and perform a similar analysis for this protocol The two protocols are then 
compared 

In Chapter 6, we consider random access systems with multipacket re- 
ception capabilities We consider a generalized common receiver model with 
transmitter based code assignment Each transmitter is provided with a set oi 
orthogonal codes. The number of such codes is much smaller than the total 
number of users m the system. Each user, before transmitting its packet selects 
one of these codes as its address and then encodes its packet with this address 
If two or more users choose the same code, then their packets collide We 
extend the optimal colhsion resolution algorithm of Chapter 3 to such systems 
The collision resolution algorithm specifies the number of users to be enabled 
for each code The dynamic programming equations are solved to derive an 
optimal algorithm The algorithm is illustrated with numerical examples In 
Chapter 7, we summarize the important conclusions of this thesis and indicate 
some directions for future investigations 
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Towards A Unified Framework for 
Random Access Algorithms 


In this chapter, we examine some of the issues involved in the study of random 
access algorithms and attempt an unified treatment of these algorithms within 
Tsybakov's formulation It is not the aim of this chapter to give an exhaustive 
review of all the algorithms, but the presentation has been made here with 
a view to illustrate the basic features of random access communication The 
objective here is to point out, in a generic way, the nature of problems being 
considered in the literature 

We begin this chapter by discussmg the Common Receiver Model We 
then give Massey's qualitative definition of a random access algorithm The 
formal definition of a random access algorithm proposed by Tsybakov for 
an infinite user model is next introduced It is then shown how various 
random access algorithms can be classified using this definition. The various 
performance measures used to characterize a random access algorithm are 
then discussed Pippenger [ 56 ] using some msightful arguments has obtained 
an upper bound on the maximum possible throughput for a class of random 
access models We examine the issue of optimality of an algorithm and the 
capacity of a random access channel m the light of Pippenger's arguments 
The mechanism of operation and performance analysis of some representative 
random access algorithms are then reviewed 

We next consider the finite user model Tsybakov's definition of a random 
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access algorithm for an infinite user model provides us the motivation to 
define a random access algorithm for the finite user model Accordingly, we 
introduce in this chapter, the formal definition of a random access algorithm 
for the finite user model We consider a class of such random access algorithms 
and review some of the existing algorithms that can be included within this 
class 

Finally, we extend our discussion to random access systems with multipackel 
reception capability Due to the presence of other parameters, there are various 
possibilities of modelling such systems We restrict our attention to the model 
which can be considered to be a generalization of our common receiver model 
We conclude this chapter by reviewing some random access algorithms foi 
this generalized model 

2.1 The Common Receiver Model 

The model used for the study of random access communication is called the 
Common Receiver Model In this model, there are many bursty sources ol 
data traffic (users) which send messages to a single receiver through a common 
communication channel In random access communication model, as shown in 
Figure 2 1, each user is equipped with a transmitter (Tx ) and a receiver (Rx ) 
If we focus our attention on the receiver of a particular user and consider an 
instance, when other users try to send their messages to this receiver, then 
this situation is equivalent to the common receiver model Thus the common 
receiver model is an instance of a random access communication model After 
taking propagation delay into account, the random access communication 
model can be considered as the superposition of several such common receiver 
models For our purposes, it suffices to focus on the common receiver model 

The messages are assumed to be broken up into segments called packets 
These packets may be of either fixed length or variable length We assume 
that fixed length packets are transmitted by the users The packets may also 
be encoded with some kind of error-correcting code The other assumptions 



CHAP TER 2 A UNIFIED FRAMEWORK 


BROADCAST COMMUNICATION CHANNEL 



Figure 2 1 Random Access Communication Model 



Figure 2 2 Common Receiver Model 
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about this model are as follows 

1 It is assumed that the channel time is divided into short time intervals 
called slots The users can transmit their packets only at the beginning 
of a slot The length of each slot is assumed to be equal to the time 
taken for the transmission of a packet 

2 The transmission of two or more packets in a slot results in collision 
or the destruction of all the transmitted packets If only one packet is 
transmitted in a slot, then that packet is received successfully In othei 
words. It IS assumed that the only form of noise present on the channel is 
the destructive interference due to simultaneous transmission of packets 

3 It is assumed that at the end of each slot, all users know about the 
state of the slot through feedback information The feedback assumes 
ternary values 0,1 or 2 depending upon, whether the slot was empty 
or contained one packet (success) or contained more than one packet 
(collision) The common receiver broadcasts this feedback on a separate 
feedback channel 

4 The feedback is assumed to be immediate and errorless and thus repre- 
sents the true state of the slot. It is also assumed, as in most studies, 
that all users are aware of the past feedback values regardless of whether 
they had packets for transmission 

Apart from the above basic assumptions, two models of user population 
are considered in the bterature These are Finite User Model and Infinite Usei 
Model 

In the finite user model, [6, 4] there is a fixed, finite set of users Each user 
generates packets independent of each other The packet generation process 
at each user is usually assumed to be a discrete time Bernoulli process In 
the infinite user model, there are potentially infinite number of users The 
aggregate traffic of new packets by all the users is usually assumed to be a 
Poisson process 
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At this point, it IS appropriate to make the following comments on these 
assumptions 

Remark 2 1.1 The assumption of slotted system requires that all useis are 
synchronized at the slot level This synchronization at the slot level may 
not be an easy task The random access algorithms for unslotted system 
have also been considered m the literature In unslotted system, the useis 
can transmit their packets at any instant The assumption of slotted system, 
however, facilitates the analysis Accordingly, we restrict our attention to 
slotted systems only 

Remark 2.1.2 The assumption that the feedback is immediately available at 
the end of the slot is somewhat restrictive It essentially ignores the effect ol 
propagation delays Such assumption is usually justified when the round trip 
propagation time is much smaller than one slot unit duration Such a condition 
however fails in Satellite Networks We may note here that Capetanakis [44] 
has suggested a random access algorithm for such satellite channels 

Remark 2.1.3 The absence of channel noise both on the actual random access 
channel and the feedback channel is the most crucial assumption which de- 
couples the random access problem from Shannon's communication problem 
Some authors [42] have studied the performance of random access algorithms 
in the presence of channel noise 

Remark 2.1.4 All the above remarks also apply to the corresponding assump- 
tions made m subsequent chapters of this investigation 

Remark 2.1.5 The communication channel with assumptions 1 to 5 is referred 
to as the random access channel in the sequel Similarly the common receiver 
model with infinite user Poisson arrivals is called the infinite user model and 
that with a finite population of users is called the finite user model 

Remark 2.1.6 There have been some departures from the above assumptions 
We describe the following important deviations from these assumptions 
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1 Binary Feedback Instead of assuming that the users receive ternary valued 
feedback information, some studies [3, 4] have assumed binary feedback 
Three types of binary feedbacks have been considered in the literature 

(a) conflict/no-conflict This feedback informs the users whether the slot 
contains more than one packet (conflict) or, equal to one packet oi 
no packet (no-conflict) 

(b) something! nothing This feedback informs the users whether the slot 
contains one or more packet {i e , something) or, it contains no 
packet (i e , nothing) 

(c) success/failure This feedback informs whether the slot contains only 
one packet (i e , success) or, no packet or more than one packet (/ e , 
failure) 

The something/nothing feedback and success/failure feedback characterize 
public key cryptosystems and spread spectrum random access systems 
respectively 

2 D-ary Feedback A general D-ary feedback model has also been consid- 
ered This feedback informs the users whether 0,1,2, ,D packets are 
transmitted or more than D packets are transmitted in a slot Thus the 
feedback informs the users about the collision multiplicity up to a certain 
degree This model has been studied by Tsybakov [73], Georgiadis and 
Papantoni-Kazakos [21] and Shiv Panwar [55] 

3 Limited Sensing We have assumed that the users monitor the channel 
continuously whether or not they have packets for transmission. Some 
models, however, have been considered which do not require a user to 
observe the state of the channel continuously, but only from the moment 
it has a packet ready for transmission till the moment the packet has 
been transmitted successfully The algorithms for such models are called 
limited sensing algorithm This model was first considered by Tsybakov 
[81] whose stack algorithm did not require the restriction of continuous 
sensing for its operation Later on, Georgiadis et al [22] and Humblef 
[32] have discussed limited sensing algorithms 
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Remark 2 17 Recently there is a lot of interest in the study of random access 
algorithms for channels with multipacket reception capability [47, 25] In sucli 
systems, it is assumed that even if more than one packet is transmitted in a 
slot, then some packets may still be received successfully The effect of capture 
phenomenon in packet radio networks [8] and code division multiple access- 
random access system [60] can be modelled by such channels We will discuss 
this model in Section 2 6 

2.2 Characterization of Random Access 
Algorithm 

In this section, we examine how to characterize a random access algorithm 
We first give the qualitative definition of a random access algorithm due to 
Massey [44] 

Definition 2 1 Random Access Algorithm is a strategy that the users follow to access 
a (random access) channel 

Random access algorithm may employ a collision resolution algorithm and a 
channel access algorithm These are defined as follows 

Definition 2.2 A collision resolution algorithm is a strategy for the (transmission 
and) retransmission of packets by the users with the property that after each collision, 
all packets involved in the collision are eventually retransmitted successfully and 
all users eventually and simultaneously become aware thai these packets have been 
successfully transmitted 

Definition 2.3 A channel access algorithm is a rule by which users decide the slot 
for the first time transmission of a newly generated packet 

We may note here that according to above definition, ALOHA is not a collision 
resolution algorithm Although Massey's definition summarizes the basic 
characterishc of a collision resolution algorithm, it does not tell whether such 
an algorithm exists at all and if it does, then how it can be synthesized 
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Tsybakov and Mikhailov [80] gave a mathematical definition of random access 
algorithm for an infinite user model We restrict our attention to the infinite 
user model in this section We will return to the finite user model in Section 
25 

2.2.1 Tsybakov’s Definition of Random Access Algorithm 

Following [74], m a slotted random access system, the packets are transmitted 
only at times t £ I where / = {0, 1, } Let N be the number of users in the 

system For the finite user model N < oo, while for the infinite user model 
N = oo Let at the instant t, the feedback vector 0{t) = {0(1), 0(2), ,0(0) 

where 0(r) denotes the feedback observed at the time r for r = 1,2, This 

feedback may assume values of 0,1 or 2 for empty slot, successful slot and 
collision slot respectively 

Let T denote the time of generation of a packet, then x € R^, where i?' 
IS the semi-infinite continuous time axis, te , R'^ = [0, oo) These instants oi 
packet generations form a Poisson process for an infinite user model Lei 
= {p'W(l), ^(=^1(2), ,p^^^(t)} where for r = 1,2, we have 

0, if the packet generated at time x 
was not transmitted during slot (r — l,r) 

1, if the packet generated at time x 
was transmitted during slot (r — l,r) 

Then for an infinite user model, a random access algorithm can be defined as 
follows 

Definition 2.4 Random access algorithm is an algorithm which evaluates the prob- 
ability function f[x,©(t),g^^\t)], with which a packet generated at time x will be 
transmitted at the instant t, le , in the slot {t,t + 1) 

Definition 2.5 Random access algorithm is a causal algorithm if f[x, 6>(t), = 

0 for X > t 



We restrict our attention to causal algorithms only 
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2.2.2 Classification of Random Access Algorithms 

Tsybakov's definition of random access algorithm provides some interesting 
classification of these algorithms [74] Let us denote the class of all random 
access algorithms by .4"^ We discuss below various subclasses of 

1 If the function f[c,0(t), = a'^ x, 0(f) and and where n is a 

specified probability taking values from 0 to 1, then the random access 
algorithm that results is the well known slotted ALOHA algorithm Let 
us denote this class by A^ 

2 Consider a random access algorithm where the function /[x, 0(f), gr^^)(f)| 
IS such that it assumes binary values of either 0 or 1 Let the class of all 
such algorithms be denoted by A'^ For an algorithm from A"^, we have 
for a packet generated at time x 

jW(t + 1) - fix, 

The above relation easily follows from the definition of Since 

can be recursively computed, the class Aj” is characterized by random 
access algorithms which (with a little abuse of notation) can be denoted 
by f[x, 0(f)] This class includes Tree algorithm [7], Stack algorithm [81] 
and Gallager's interval searching algorithm [16] These algorithms are 
discussed in Section 2 4 If the function /[a;, 0(f)] = 1 for x € (f — l,f], 
then we have free access stack algorithm of Tsybakov [81] 

3 Another subclass of A°° is the class consisting of all algorithms with 
function f[x,0(t),gf^\t)] depending only on 0(f) and not on x and 

An example of such class is the adaptive algorithm [74] 

The classification of all these algorithms is depicted m Figure 2 3 

2.2.3 Performance Measures of a Random Access 
Algorithm 

After having defined a random access algorithm, we turn our attention to 
various performance measures which are used to characterize the efficiency 
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Figure 2 3 Classification of Random Access Algorithms 
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of a random access algorithm Two main criteria for evaluating a random 
access algorithm are delay and throughput Steady state analysis under 
dynamic operation of the algorithm involves the study of stability behavior ol 
the algorithm Some other parameters of interest are backlog of the system 
and average collision resolution length We summarize the notion of delay, 
throughput, stability, backlog and average collision resolution length in the 
following 

Packet Delay 

The packet delay is the time from the moment of a packet's generation to the 
moment of its successful transmission The average packet delay has been 
interpreted by various authors in the following ways 

1 Let be the delay encountered by a packet generated at time x Then 
the average packet delay can be defined [74] as 

Pi = lim Ei^x] (2 1) 

x—^oo 

2 Another definition of packet delay used in the literature [20] is as follows 

Let the packets be indexed as 1,2, according to the order of then 
arrival instants Let 6^ be the delay experienced b)' the ^th packet Then 
the average packet delay is defined as 

P2 = 

3 For an infinite user model employing Gallager's algorithm, the average 
packet delay is defined in [31] in the following way 

Vz = hm EW] (2 3) 

1— +00 

where 6’ is the delay encountered by a randomly chosen packet arriving 
m the zth enabled interval ’ 

’The enabled interval is defined in Section 2 3 
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Throughput 

There are various definitions of throughput considered in the literature 

1 According to one definition of throughput, it is the supremum of the 
input traffic arrival rates A such that the packet delay remains bounded 
Thus throughput % can be written as 


% = sup{A V < oo} 

where V is any of the delays defined earlier 


(2 4) 


2 Let i be the time instant when all packets generated before time t have 
been successfully transmitted Then throughput can be defined as 

t 


Ti = hm 

i—ioj 


E[t] 


(2 5) 


Here the arrival rate A is assumed to be equal to one 


3 Let n{t) be the number of packets successfully transmitted from 0 to t 
Then let 7^(A) be defined as follows 


Ti{X) 


f lim(_oo E 


lo 



if 22 < OO 

otherwise 


(2 6 ) 


The throughput of the random access algorithm, % is then defined as 

r3 = supT3(A) (2 7) 

A 

4 The following definition of throughput is a much stronger definition than 
that given by (2 4) 


% = sup{A hm hm Proh[6j < A:] = 1} 

J—^oo 


( 28 ) 


Stability 

A random access algorithm is inherently stable if the throughput T > 0 and 
unstable if T = 0 Note that ALOHA algorithm is inherently unstable for the 
infinite user model Random access algorithms employing collision resolution 
by tree or stack algorithm, however, are stable algorithms 
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Backlog 

A packet IS said to be backlogged at any instant, if it has not been transmitted 
successfully till that instant Let Ni be the number of backlogged packets at 
time t, then the average backlog of the system is defined as 

A/'=limE[AfJ (2 9) 

t— »ou 

The stability of the random access system may also be defined with respect to 
this backlog Thus a random access system is said to be stable if the following 
condition is satisfied 

hm hm Prob[Nt <k] = l (2 10) 

k—*oot~^oo 

Average Collision Resolution Length 

As defined earlier, let T be the time instant when all packets generated before 
time t have been successfully transmitted Then Tsybakov [74] defines the 
average delay associated with an algorithm / as follows 

V{f) = hmE^-t] (211) 

t—*oo 

Under steady state condition, as it will become evident from Section 2 4, this 
delay is the same as the expected collision resolution length in stack algorithms 

2.3 Capacity of Random Access Channel for In- 
finite User Model 

Definition 2.6 Let the capacity of a random access channel, with random access 
algorithms of class A°°, be denoted by C{A°°) Then C{A°°) is given by 

C{A°°) = sup{r feA°°} (2 12) 

where T is one of the throughputs defined earlier 

Definition 2.7 A random access algorithm with throughput T equal to the capacity 
C(.4^') IS called an Optimal Algorithm 
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The determination of the capacity of a random access channel for the infinite 
user mode] over class is still an open problem Attempts have been made 
to formulate the capacity problem over class A"^ algorithms However even 
for this class, only bounds are available Vvedenskaya and Pinsker [83] have 
recently considered a subclass of A’^ and obtained an optimal algorithm for 
the infinite user model over this subclass 


Formulation of the Capacity Problem 

Since the bounds on the capacity of a random access channel are available 
only over the class algorithms, we restrict our attention to random access 
algorithms over class in this sechon The class A"^ is characterised by the 
function f[x, 0(t)] which assumes the values of either 0 or 1 The problem 
of determining the capacity for the infinite user model can be reduced to the 
following problem 

Let us consider the set B[t\ = {x f[x, 0(f)] = 1, a; G Thus set B{t) at 
time instant t contains all such generation instants x £ for which packets 
are transmitted Thus any random access algorithm from class can be 
specified by the collection of measurable sets The packets are generated 

according to Poisson process of intensity A = 1 We say that the set B{t) is 
enabled at time t, if all those packets with their generating instants belonging 
to this set are allowed to transmit in the slot (f, f + 1) 

Any algorithm in class Af can be considered as embedded in an infinite 
ternary tree graph as shown in Figure 24 Each node is connected by three 
branches to three other nodes These three branches correspond to whether 
the slot is empty, contams one packet (i e , success) or contains more than one 
packet (/ e , collision) For a given value of 0(f) = {^(1), 0(2), , 9(t)}, there is a 

unique path through this infinite tree This path will have t branches and f + 1 
nodes The measurable sets associated with these nodes are J5(l), B{2), , B(t) 

Now let us consider the finite subset £ = [0, x] c Let K denote the 
set of all nodes of the tree representing the algorithm Let k £ K he some 
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Figure 2 4 Infinite Ternary Tree Graph Nodes are indicated by circles with 
the root at the top, leaves or terminal nodes are indicated by the squares 
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node Let Bj, denote the measurable set associated with A ^ Let denote 
the probability that the random access algorithm used for transmitting packets 
generated within the interval £ will ever visit k Then the average number ol 
slots required for the transmission of all packets of £ is given by 


Em] = E PA 

keK 


(2 13) 


Note thatT^r) is the time instant, when all packets generated before the instant 

X have been successfully transmitted Let qo,k-~<l\,K and ^ 2 ,/t be the probabilities 

that empty, success or collision is observed, when the set Bk is enabled at 

node k Then the average number of packets transmitted is Y, Pa.'I'i *. 

k^K 

then have 

E PA9i,fc = X (2 14) 

k&K 

The right hand side follows from the fact that the intensity of Poisson process 
is assumed to be one here 


The capacity of the random access channel with respect to throughput T, 
can then be determined by the relation: 




sup 


lim - 

2:-^oo £'[?(x)] 



S PkQl.k ' 
keK 

E Pk 

k^I^ j 


(2 15) 


No general method is available for evaluatmg this expression of the capacity 
of random access channel However many authors have derived an uppei 
bound on this capacity We present below some of these results 


2.3.1 Upper Bound on the Capacity 

Using information theoretic arguments, Pippenger has shown that the capacity 
over class .4^ is upper bounded by 0 7448 Following [2], we present below 
a sketch of Pippenger's approach 


^This sol Bi IS equal to i?(0 )f the node k was visited at the instant t and so on 
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As explained above, when an algorithm over class is used to transmit 
all packets belonging to some finite interval [0, t\ on the generation time axis, 
then there is an associated path through the infinite tree When all packets 
of the interval [0, r] have been transmitted successfully, say at T{x), we say 
that the interval [0, t] has been resolved At this stage we reach the terminal 
node Let the random variable L denote this terminal node The entropy ot 
L, then equals the average amount of information required to specify which 
path through the infinite tree was followed to reach the terminal node from 
the root node It can be shown that H{L), the entropy of L is bounded from 
above in the following way 




+ {E\7{x)] - x} log 2 


( 216 ) 


where H(y) = -ylogy-(l -y)log(l-y) and = 

be shown [2] that 


E Pi 
k^K 


H(L) > log e 

From Equations 2 16 and 2 17, we have 


Similarly it can 
(2 17) 


X log e < SiL) < B[r(x)] H + {SR’:)] - *} log 2 (2 18) 

As we take the limit of this expression as a: — > oo, x/E^ix)] gives the throughput 
T (with T = %) o{ the random access channel Taking therefore the limit ol 
this equation as x tends to infinity, we can write 


rioge<iT(T) + (l-70Iog2 (219) 


The capacity C is the maximum value of T satisfying this equation It can be 
shown that this maximum value of T is 0 7448 Thus 


C < 0 7448 


(2 20 ) 


Remark 2 3.1 In this section, we have defined the capacity with respect 
to throughput An important theorem due to Tsybakov [79] relates the 
throughput X to 7] This theorem states that if an algorithm f has a throughput 
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% >0 and i?lF] < oo where t js the time instant when all packets generated 
before time t have been successfully transmitted, then there exists an algorithm 
/' with throughput % = T> 

The bound on the capacity was further sharpened by Molle [50] using a 
completely different argument to 0 673 Later on, Cruz and Hajek [10] refined 
Molle's arguments and reduced the upper bound to 0 612 Tsybakov and 
Mikhailov [48] obtained an upper bound of 0 578 The best known bound ol 
0 568 is due to Tsybakov and Likhanov [77] 

2.4 Review of Random Access Algorithms for In- 
finite User Model 

In this section, we review some of the existing algorithms proposed in the 
literature for an infinite user model Historically, the earliest and simplest 
random access algorithm was ALOHA There are various versions of ALOHA 
and all can be grouped under the class ,4^ But these algorithms are inherently 
unstable and require some control mechanism On the other hand, algorithm*- 
over .4^ are not only stable but provide higher throughput Our interest in 
.4“ IS also motivated by the appeahng conjecture of Tsybakov [74] that an 
optimal algorithm over the class ^4“ is also optimal over the entire class A°^ 
In order to develop an appreciation of the importance of algorithms over 
we first discuss ALOHA algorithm 

2.4.1 ALOHA Algorithm 

In a slotted ALOHA protocol considered here, a newly generated packet is 
transmitted in the first slot after its generation If two or more packets are 
transmitted in a slot, they collide and become backlogged The backlogged 
packets are transmitted with fixed probability o m each successive slot until 
they are successfully transmitted ^ We now show that such a random access 

^Iii another version of ALOH A., the newly generated packet, instead of transmitting immediatel\, 
inav transmit in the next slot with probabilitv a or with some different probabilitx o' 
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system is unstable 


Instability of ALOHA 

Let N,, t e I be the number of backlogged packets at time t Let A be the 
intensity of the overall traffic Let Xt denote the number of newly generated 
packets transmitted during the slot (t,t + 1) Let Yt denote the number oi 
backlogged packets transmitted durmg the slot {t,t+ 1) {Xt,t e /} is assumed 
to be a sequence of independent and identically distributed random variables 
In our infinite user model, this is a Poisson process, i e , 

— 1 \ z 

c, = PTob[Xt = ^] = ■ ■ (2 21) 

I' 

Since o IS the probability with which backlogged packets retransmit, we have 

b,{n) = Prob[Yt = j\Nt = n]=^^ o^(l - (2 22) 

It can be shown that {Nt, f € /} is a Markov cham According to the definition 
of stability, our system is stable if limi_,oo Prob[Ni < j] = 0 for all finite values 
of j To prove that this condition does not hold for ALOHA algorithm being 
considered here, it is sufficient to show that the Markov chain {Nt,t € /} is 
not ergodic Indeed it has be shown [19] that the Markov chain {Nt,t e /} is 
not ergodic for A > 0 

Control of ALOHA 

The instability of ALOHA has generated several interesting control problems 
It can be shown [19, 28, 72, 62] that ALOHA algorithm can be made stable 
by the closed loop control policies One such class of policies is based 
upon choosing the retransmission probability on the basis of the number ol 
backlogged users Thus the retransmission probability is no longer constant 
but IS a function of the number of backlogged users It can be shown [19] that 
if a control policy chooses the retransmission probability a;(f) durmg the slot 
(f, f + 1) based on Nt, then the system is stable if A < d and unstable if A > <1 
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where d = lim„ + (-0^1 (»'’)] follows from this that the optimum policy 

which yields the maximum throughput will choose the optimum retransmission 
probability o* by the relation o* = 1/r; where n is the number of backlogged 
users For a = o’, the optimum value of dis d = [1-1/n]" ’ and the maximum 
throughput obtained is 1/e = 0 368 packet/slot 

Note however that the number of backlogged users is not generally known 
to the users The information available to the users is the feedback information 
0(f), the history of packet transmissions and the time of packet arrival 7 

Segall [67] has obtained exact recursive equations for estimating the number ol 
backlogged users given the past feedback values For an infinite user model, 
however, these estimation equations are infinite dimensional Therefore it is 
necessary to consider suboptimal control policies One such policy suggested 
by Hajek and van Loon [28] makes use of the feedback information to give 
a recursive updating law of the retransmission probability Our ALOHA 
algorithm can now be represented by /[0(f)] = a;(f) A recursive control ol 
the following form was suggested in [28] ^ 

oc{t + 1) = C;[a(f), 0(f)] 

where G is a function G . [0, 1] x {0, 1,2} — + [0,1] 

It was shown in [28] that with this type of control policy, stability can be 
achieved for arrival rate A < 1/e = 0 368 

Another suboptimal control policy which is similar to certainty equivalent 
control was suggested by Rivest [62] This is also known as the Pseudo Bayesian 
strategy We know that the optimum value of retransmission probability a1 
time f IS a = a’ = 1/n where n is the value of the number of backlogged useis 
at time t, i e , Nt = n In Rivest' s scheme, we use an estimate of the number 
of backlogged users Let denote an estimate of the number of backlogged 
users at time f This estimate is updated accordmg to the following rule 

^ _ ( max{l,/^t+i - 1 + if the slot (f,f + 1) is empty 

+ -^ +'^ if the slot (f,f + 1) is successful or collision 

where 'X is an estimate of the arrival rate A The above updating law is 


more geiiorAl polio can be of the form expressed by a(/ + 1) = G[a;(0), a(l), ,a{i),0{t)] 
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motivated by an approximation of the exact Bayesian formula for updating 
the optimal estimate of N, given the past feedback observations It was shown 
by Tsitsiklis [72] that such a scheme is stable for X < l/c An estimate oi A 
can be obtained on line but it was proved in [72] that if ^ = 1/e is chosen to 
update the estimate of the number of backlogged users, the algorithm achieves 
the same throughput which would have been obtained for the case where A 
IS known 

We may note here that even the controlled ALOHA algorithms use only 
the global feedback information available to all users, i e , the feedback vec- 
tor Thus all users use the same retransmission probability These algorithms 
do not make use of the transmission history g^^\t) and the generation time 
of packets Capetanakis's tree algorithms, Tsybakov's stack algorithm and 
Gallager's algorithm seek to incorporate these informations Since these al- 
gorithms make use of the available information in a better way, they can be 
expected to yield higher throughput Indeed as we shall see below that these 
algorithms not only give higher throughput but are also inherently stable All 
these algorithms form a class denoted by A'^ 

2.4.2 Stable Random Access Algorithms of Class 

In this Section, we discuss some of the random access algorithms which can 
be included in class These random access algorithms can be shown to 
consist of a channel access algorithm and a collision resolution algorithm As 
already mentioned in Section 22, collision resolution algorithms are used for 
resolving collisions and channel access algorithms specify when packets may 
]oin the collision algorithm We first discuss the channel access algorithms 

Channel Access algorithms 

Mainly three channel access algorithms have been considered in the literature 
They are 


• Blocked Access 
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• Window Access 

• Free Access 

Blocked Access In blocked access, the operation of the random access system 
can be divided into several transmission intervals called epochs The 
packets generated in one epoch are transmitted for the first time in first 
slot of the next epoch If a collision occurs in this slot, i e , if more 
than one packet had been generated in the previous epoch, the collision 
resolution algorithm resolves this collision No new packet can transmit 
in this epoch, while the collision resolution algorithm is in operation 

Window Access The window access is similar to the blocked access in the 
sense that in window access also, the packets that arrived during a 
specific period are transmitted in an epoch, while the other packets wail 
till the end of this epoch The window access algorithm operates on 
the principle of decoupling the transmission time axis from the packet 
arrival time axis The packet arrival time axis can also be divided into 
several epochs Then in window access algorithm, packets that arrived 
during the zth arrival epoch are transmitted in the first utiltzable slot [44] 
following the collision resolution epoch for packets that arrived during 
{t — l)th arrival epoch Here the term utiltzable slot is used, because the 
collision resolution epoch for packets arrived dunng {i — l)th epoch may 
end before the zth arrival epoch Since we have considered constant 
window sizes in this access algorithm, some slots may be wasted if the 
collision resolution epoch ends earlier® The window access algorithm 
has been illustrated in Figure 2 5 

In blocked and window access algorithms, the function f[x, 0(i)] = 0, li 
the packet arrival time x does not belong to the previous epoch and the 
specified window 

EVee Access In free access algorithm, a newly arriving packet does not wail 
but transmits immediately in the next slot of its arrival If a collision 


"^This problem can be removed by using variable window sizes 
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Figure 2 5 Illustration of Window Access Algorithm 


occurs in the slot, then the packet joins the group of other collided 
packets and follow the collision resolution algorithm The operation ol 
free access algorithm can be best explained by Tsybakov's stack algorithm 
and will be discussed later in this section 


Collision Resolution Algorithm 

The first collision resolution algorithm was proposed by Capetanakis [7] and 
independently by Tsybakov [78] Tsybakov's stack interpretation of the collision 
resolution algorithm [81] lends naturally to its use with free access Later on 
Gallager [16] proposed another collision resolution algorithm for the infinite 
user model We discuss below the operation of some of these algorithms 

1 Capetanakis Tree Algorithm The tree collision resolution algorithm oi 
Capetanakis can be used in conjunction with either blocked access oi 
window access The algorithm can be explained as follows- 
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All users involved in collision divide themselves into two parts The 
algorithm first operates on one of these parts The users belonging to 
this part are allowed to transmit in the next slot If a success or an empty 
feedback is observed, then the collision of this part is resolved and the 
algorithm then operates on the second part However, if collision occuis 
due to transmission of the first part, then this part is further subdivided 
into two parts This procedure continues till all users have resolved 
their collisions The algorithm then returns to the initial second part 
and repeats the procedure The operation of the algorithm can be best 
illustrated with help of binary tree as shown in Figure 2 6 The root node 
indicates the first slot of the collision resolution epoch The splitting ol 
users involved in collision in this slot generates two subtrees from the 
root The users can split themselves in two ways- 

• By tossing a fair coin Those tossing head join the left subtree and 
transmit m the very next slot, while those tossing tad join the nghi 
subtree and wait till the users on the left subtree have resolved their 
collisions 

• By using the arrival time of packets The channel access algorithm 
specifies an initial time interval After collision, all packets that 
arrived during the first half of this interval join the left subtree and 
retransmit in the very next slot, while packets during the second 
half of the interval join the right subtree 

We note from above that the operation of Capetanakis's tree algorithm 
does not distinguish between success and empty slots It was, however, 
Massey [44] who noted that if a collision slot is followed by an empty slot, 
then it means that the set of users who tossed head is empty and therefore 
outcome of the next slot due to transmission of the other set of useis 
IS predetermmed to be a collision The users therefore, can immediately 
toss their coins and continue with the collision resolution algorithm 
This modified algorithm yields higher throughput than the basic tiee 
algorithm While Capetanakis's tree algorithm with blocked access and 
window access gives throughputs of 0 346 and 0 429 respectively, the 
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Figure 2 6 Capetanakis's Tree Algorithm 
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modified tree algorithm gives throughput of 0 375 and 0 462 with the 
respective channel access algorithms 

The modified tree algorithm, however, is extremely sensitive to feedback 
errors The algorithm can enter into a deadlock if due to feedback error 
an empty slot at any stage is mistaken to be a collision slot by the users 
The algorithm will cause the splitting of users " involved in collision” 
into two parts But since there were no such users, this will result in 
empty slot The modified algorithm, however, will again cause splitting 
as this empty slot is preceded by a collision slot Thus the algorithm 
continues splitting, resulting in a series of empty slots The problem can 
be resolved if, after a series of R empty slots is received, the algorithm 
allows the set of users to transmit in the next slot without splitting The 
value of R can be chosen appropriately depending on the feedback error 
and the desired performance 

We now provide below a gist of the throughput analysis of tree algorithm 
with blocked access for an infinite user model 

The number of slots, a collision resolution epoch lasts is called collision 
resolution length Let Ln denote the expected collision resolution length 
when the number of users transmitted in the initial slot of the epoch is 
n Then from the description of Capetanakis's tree algorithm, we can 
write the following relations 


Lo = L, = l 


(2 23) 


L. = l + i2(L, + L„-J”)o^il-ar-’ (224) 

;=0 V -?/ 

Here we have assumed that the users toss a biased com for splitting 
themselves With probability a, the users join the left subtree and with 
probability 1 - a, they join the right subtree 

For a fair coin a = 1/2 and we can write for 


Ln = 


n-1 

+ 2Ei; 
;=0 




(2 25) 


1 - 2 ^-” 
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Massey [44] has given tight upper and lower bounds on the expected 
collision resolution lengths 

2 8810N - 1 < < 2 8867 N - 1 for n > 4 (2 26) 

Let {A,? = 1,2, ,} denote the sequence of collision resolution lengths 

Similarly let { 17 ,, z = 1,2, , } denote the sequence of number of packets 

transmitted in the first slot of collision resolution epochs Then we have 


(\PYp->'f 

Prob[ri^^-i = n \ Pi = £] = — for n = 0,1,2, (2 27) 

It can then be shown that [44] 

E[V^^,] = XE[P^] (2 28) 

Since Ln = ElPi | ??i = ri], using this equation and the bounds from 
Equation 2 26 on L,i it can be deduced that 

EM < a 0 P 

where 7 = 2 8867 If we take the limit of this expression as % 00 and 

if A < 1 / 7 , then 

lim Eiili] = E[t]] < . ^ T 

2— »00 1 — 


Thus the expected backlog is finite if A < 0 3465 Similarly it can be 
shown that the expected backlog is infinite if A > 0 3471 

2 Tsybakov's Free Access Stack Algorithm The tree algorithm was originally 
proposed to operate with blocked access Simultaneously and indepen- 
dently, Tsybakov proposed blocked access stack algorithm Both the 
algorithms are similar, except in the representation of their operations 
However, the stack interpretation easily allows the use of colhsion resolu- 
tion algorithm with free access or non blocked channel access algorithms 
The free access stack algorithm was proposed by Tsybakov [81] While 
m the blocked access algorithms, the function defining the complete 
random access algorithm, 1 e , f[x, 0 (f)] depends upon the entire vector 
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€>{f) = {0(1), 6^(2), ,0(0}/ iri free access' stack algorithm /[t, 0(/)] does 

not depend on 0(?) for ? < r + 1 Thus the user need to monitor the 
channel only when there is a packet for transmission The operation ol 
the basic stack algorithm has been summarized in [81] 

The analysis of the stack algorithm is more difficult to perform The 
collision resolution epoch in stack algorithm is the time interval which 
begins with a collision slot and ends at the moment, when all useis 
know for the first time that not only the packets involved in the initial 
collision, but also those packets that arrived during this interval have 
been successfully transmitted 

As before, let denote the expected collision resolution length with n 
packets being transmitted in the first slot of the epoch The asymptotic 
analysis of Fayolle et al [14] and Mathys et al [45] mdicates that 
the lim„_ooAi/^^ does not converge but exhibits an oscillating behavior 
Mathys [45] showed that the stable throughput that can be achieved for 
users tossing fair coins is 0 36 packet/slot 

3 Interval Searching Algorithm' The interval searching algorithm was pro- 
posed by Gallager [16], Tsybakov and Mikhailov [80] and Ruget [65] 
simultaneously for an mfinite user model This algorithm is similar to 
the tree algorithm, but the splitting of users into two parts is done using 
arrival time of the packets The algorithm starts by enabling the time 
mterval [0, x] If it results in the slot being empty or success, then the 
collision resolution epoch ends and the algorithm then selects the next 
mterval However, if a collision occurs, then the enabled time interval is 
split mto two parts and packets in the left half of the interval retransmit 
m the next slot Gallager [16], [18] observed that if a collision slot is 
followed by another collision then no information is obtained about the 
number of packets in the right half of the interval Then this right half 
can be added back to the arrival time axis Thus the collision resolution 
epoch m an interval searching algorithm that begins with a collision slot, 
ends after two successive successful slots have been observed At this 
stage, a portion of the initially enabled mterval on the Poisson arrival 



CHAPTER 2 A UNIFIED FRAMEWORK 


42 


axis would have been resolved in the sense that all those packets thal 
arrived during this portion have been transmitted successfully by the 
end of the collision resolution epoch 

The interval to be enabled initially at the beginning of the collision epoch 
can be optimized for maximum throughput The optimum interval 
searching algorithm has a throughput of 0 4888 Thus this algorithm 
yields the highest throughput amongst all known algorithms for the 
infinite user Poisson arrival model The interval searching algorithm has 
the additional property that all packets are transmitted in the order ol 
their arrival It is also referred to as the First Come First Served (FCFS) 
algorithm 

Let us define the following quantities 

W(x)= expected length of the collision resolution epoch conditioned on 
the event that the collision resolution algorithm enabled an interval 
of length X 

T(x)= expected length of fraction of the resolved interval conditioned on 
the event that the collision resolution algorithm enabled an interval 
of length X at the begmning 

Let Wn{x) and T„(x) denote respectively the values of W{x) and T{x) 
conditioned on the event that the initial collision multiplicity is n Then 
we can write 

00 

W(X) = 

n=0 ^ 

oo p-^rpn 

T(x) = 

n=0 ^ 

The quantities Wnix) and T„(x) can be calculated recursively as shown 
in [80] If we now use the following definition of throughput which is 
already given in Section 22 3 

T = sup{A lim lim Prob[6j < = 1} 


(2 31) 
(2 32) 
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then Tsybakov [80] has shown that the throughput T as defined above 
can be calculated by the following expression 

T T(t) 

^ W{x) 

which can be shown to yield T = 0 487 

4 Limited Sensing Algorithms Limited sensing algorithm is a generalization 
of the concept of free access stack algorithm We may mention here that 
free access stack algorithms achieve lower throughput than that of the 
blocked access or window access stack algorithms for the infinite user 
model 

An advantageous feature of free access is that the users need not know 
the past channel feedback history But at the same time this puts 
a newly generated packet into asynchronism with the system in the 
sense that a user is unable to decide whether a collision resolution 
algorithm is in process or not It was Humblet [32] who observed 
that a user after generatmg a packet can start monitoring the feedback 
for a long time until it is able to detect the boundaries of collision 
resolution epoch It then transmits its packet and participates in the 
collision resolution process Georgiadis et al [23] exploited this idea and 
proposed modification to Gallager's interval searching algorithm They 
showed that the throughput of the algorithm depends upon a system 
parameter and indeed it is possible for the algorithm to achieve the 
throughput of 0 487 as the value of this system parameter mcreases 


2.5 Random Access Algorithm for a Finite User 
Model 

We have discussed above several random access algorithms for an infinite 
user model We know that the random access algorithm for an infinite user 
model can be described by the function which depends upon 

the packet's arrival time, the feedback history and packet's own transmission 
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history In this section, we define a random access algorithm for the finite 
user model 

In a finite user model, there are large number of finite users and all these 
users are indexed or addressed Thus each user is identified by its address 
In general, the users may be provided with buffers of finite or infinite storage 
capacity The packet arrival process to each user is assumed to be discrete 
time stochastic process It is usually Bernoulli process but the packets may 
also arrive according to Poisson or any other arrival process These packets 
are stored in the buffer in the order of their arrival, till they are transmitted 
successfully If the buffer is of finite capacity then the packets which are 
generated after the buffer is full, are assumed to be lost The random access 
algorithm governs the transmission of the packets which are stored in the 
users' buffers 

Conceptually, we may also view this problem as a queueing system where 
each user has a queue of packets to be transmitted The channel acts as the 
server However, the server has no knowledge of which users have packets 
and how many of these packets are present in a user's buffer The information 
about packet queues is thus distributed 

2.5.1 Definition of Random Access algorithm for Finite 
User Model 

The random access algorithm for finite users may thus depend upon the 
address of the user, the time of packet arrival and the feedback history Lei 
N be the total number of users in the system Let these users be addressed as 
1,2, ,N The packets arriving to a user may also be indexed as j = 1, 2, in 
the order of their arrival in buffers Let 0(f) = {9(1), 9(2), vvhere 9(i) 

IS the feedback received at the mstant r Similarly let gl(t) denote the history 
of transmission of the packet indexed as j in ith user where i G {1,2, ,N} 

Then g^,(t) = {y^(l),^(2), ,9i(f)}, where gl(r) = 1 if the jth packet of the 

ith user was transmitted during the slot (r - l,r) and g^(r) = 0 otherwise, for 
r = 1,2, ,f Tsybakov's definition of random access algorithm for an mfinite 
user model has been discussed in Section 2 21 Motivated by this defnition, 
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we now provide the definition of random access algorithm for a finite user 
model 

Definition 2 8 The random access algorithm for a finite user model is an algorithm 
which specifies the probability function f[i,j, loith which the packet indexed 

as j in ith user will be transmitted in the slot {t,t + 1) 

We restrict our attention to only those class of random access algorithms 
which allow the first packet of a user's buffer to be transmitted successfully 
first and till then, other packets of that user wait After this first packet has 
been transmitted successfully, all other packets advance their positions in the 
buffer by one In other words, we consider only those algorithms for which 
f[i,j, 0 (f), 5 f^(f)] = 0 if ^th packet is not the first packet of zth user's buffer at 
time t Let us denote the class of all such random access algorithms by 

Definition 2.9 The class comprises all those algorithms for which the function 
- Oyj e {1,2,3, } if the following condition is not satisfied 

/[i, k, 0(r), ^(t)] = 1 

and 6{r + 1) = 1 

for some r G {0, 1, , t — 1} and Vl<A:<j-l 

Along the lines of Section 2 2 2, we can now classify random access algorithms 
for a finite user model Two important subclasses of the class .4^ are as 
follows 

1 Class A^ If the function fU,j, Oit),gi{t)] = a where a is same for all 
users, then the resulting random access algorithms are called ALOHA 
algorithms 

2 Class A^ If the function takes only two values 0 or 1, 

then that class of algorithms is denoted by Af Clearly, here we have 
gl{t + l) = f[i,j, Thus the random access algorithm within this 

class can be represented (with a little abuse of notation) by the function 

0(f)] 
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Remark 2.5.1 The random access algorithm within the class Ay can be com- 
pletely described by the sequence of sets e /} where the sel B{f) 

contains the addresses of users allowed to transmit the first packets of their 
buffer (if any) at the time instant t For example at the instant f, if some ni useis 
are allowed to transmit {i e , they are enabled), then set B{t) — {21,12, ,2m}/ 

where 2* e {1,2, ,N} and for those 2; € B(t), 0 (t),gl^{t)] = 1 and j is 

the first packet in the buffer of user ik 

Remark 2.5.2 In the infinite user model, each packet can be considered as a 
user and the packet's generation instant can be mapped into the corresponding 
user's address It is then possible to define a random access algorithm toi 
the infinite user model using the same function ^[2,:/, ©(t), g((f)] where now 
2 G {1,2, } and ^ = 0 or 1 However, we have used the definition of Section 

2 2 1 so as to conform to the literature 

2.5.2 Parameters for Characterization of Random Access 
Algorithm 

Similar to that of an infinite user model, the parameters used to characterize 
a random access algorithm for a finite user model are delay, throughput and 
stability The definitions of delay, throughput and stability are similar to those 
defined in Section 2 2 

• The packet delay for a finite user model, however, may be dependent 
upon the user's index Thus let 63,(2) be the delay of a packet arriving at 
time X at the 2 th user, then the average packet delay at user indexed as 
2 IS given by 

Di( 2)= limF;[6,(2)] (2 34) 

X— *00 

With the packets indexed as 1, 2, according to the order of their arrivals 
at the user 2, let 6^(2) denote the delay experienced by the jih packet 
Then the average packet delay at the user 2 is also defined by 



CHAPTER 2 A UNIFIED FRAMEWORK 


47 


• If we assume that packets arrive to each user's buffer according to a 
Poisson process of intensity X/N such that the combined intensity is A, 
then as in Section 22 3 the throughput can be defined as 

T] = sup{A I>(?) < cxj,V7} (2 36) 

where V{i) is any of the delays defined earlier at the user % 

The other defintion of throughput given in Equation 2 7 can also be used 
here 


• A finite user random access system is stable if T > 0, otherwise it is 
unstable 

The stability of a finite user model can also be defined in the following 
way Let Q(t) = [(5i(*), QaC*), i Qiv(0]/ where Qi(t) = Number of packets 
m the queue of zth user at time t The system is said to be stable if the 
size of the queue remains bounded at each user as the system is allowed 
to operate for a long time In other words a finite user random access 

^ If 

system is stable if lim^^^^oo limt_,oo Pro6[{(5j(^) < ^1^* ' ■ 

As in Section 2 3, the capacity of the system is defined as the supremum of 
throughputs achievable over all possible algorithms The following proposition 
can then be proved [43] for a finite user random access system 

Proposition 2 1 The capacity of a finite user model is one 


This fact can be illustrated as follows 

Let us assume that packets arrive to each user accordmg to a Poisson 
process of intensity X/N such that the combined mtensity is A, then from [74] 
we note that the system is stable if the following condition is satisfied 




A< 1- 




Suppose TDMA strategy is used in a finite user model In this strategy, there 
IS a frame of N slots At the beginning of each frame, each user is allotted 
one slot of the frame The user transmits its first packet of the buffer in the 
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slot allocated to it Thus a user is allowed to transmit only one packet per 
frame Then it is obvious that the packets' queues would remain bounded 
with probability one if the total arrival intensity A is kept less than one Thus 
a TDMA strategy has a maximum throughput of one, i e , it achieves the 
capacity of a finite user model 

Remark 2.5.3 Though TDMA seems to perform better than ALOHA in the 
sense that TDMA can accept an arrival rate up to 1 packet/slot, but the 
advantage of ALOHA is that when the packet arrival intensity is smaller than 
(I — then ALOHA yields much lower average delay than that ol 

TDMA If the arrival rate is between A = (1 — 1 /N)^~^ and A = 1, then one 
would prefer TDMA in comparison to ALOHA The question that needs to be 
asked here is -do better random access algorithms exist which can yield lower packet 
delay than that of TDMA for the range of arrival rates mentioned above'^ 

In a finite user random access model, it is therefore of interest to in- 
vestigate stable random access algorithms which have better average delay 
characteristics 

2.5.3 Review of Random Access Algorithms for Finite Usei 
Model 

We now provide below a brief review of two random access algorithms These 
are 


• Tree Algorithm of Capetanakis 

• Group Testing Algorithms 

These algorithms consist of a channel access and a collision resolution al- 
gorithm The operation of the system can be divided into several collision 
resolution epochs In addition it is assumed in these algorithms that the users 
have only two buffers The first buffer contains the packet which undergoes 
the collision resolution in the current epoch while the second buffer contains 
any packet that might arrive during the epoch 
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Tree Algorithm 

The tree algorithm of Capetanakis for a finite user model puts a restriction 
on the number of users in the system The number of users in the system 
can only be a power of two Let the number of users be N = 2^ The useis 
are addressed as 1,2, ,7V The users are assigned to the leaves of a binary 

tree The algorithm assumes that each user can generate only one packet per 
epoch 

The depth of a node is defined [6] as the number of branches between the 
node and the root node The depth of the root node is zero The number ot 
branches from a node is called the degree of a node Let the nodes of the tiee 
be denoted by where i < j <2^ and 0 < ^ < TV The algorithm operates as 
follows 

Initially all users are enabled or allowed to transmit If there is no collision, 
then all users are resolved, otherwise, the users on top half of the tree retransmit 
in the very next slot and those on bottom half wait till any collision among 
the users on the top half have been resolved The procedure is continued 
till there is no more collision to be resolved or the iCth level of the tree is 
reached The number of slots used m a colhsion resolution epoch is twice the 
number of nodes visited 

If ternary feedback is available, then Massey's modification [44] can be 
incorporated In this modified tree algorithm if a collision slot due to the 
transmission of users is followed by an empty slot, then users on bottom hall 
of the subtree under consideration are further divided into two parts 

Let p denote the probability that a user has a packet at the beginning ol 
the colbsion resolution epoch Let L{N}p) denote the expected length of the 
collision resolution epoch Then as shown in [6], we have 

HN,p) = 1 + ^" 2 - {l - (1 - pf- - 2''-p(l - (2 37) 

1 "] 

In this equation N = 2^ We note from this expression that the tree algorithm 
performs worse than TDMA if p > 1 /V2 If the probability that a user has a 
packet is known, then Capetanakis has suggested an optimum tree protocol 
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This optimum tree protocol strives to minimise the expected number of slots 
needed to resolve collisions among the N = 2^' users In the basic tiee 
algorithm, the root node has degree 2^' Let 2^^ be the degree of the node in 
an optimum tree protocol where iC' = 1,2, ,K Capetanakis [6] has derived 
an expression for choosing the optimum value of K’ which minimizes the 
expected length of the collision resolution epoch 


It can be shown [6] that the maximum average throughput for a binary 
tree algorithm with N = 2^' users and with the degree of the root node being 
equal to 2^' is given by 


T = 


1 


(2 38) 


Group Testing Based Random Access Algorithms 

Another random access algorithm that was apphed to the finite user model 
was based upon the idea of group testing algorithms considered in statistics 
The classical group testing methods are based upon classifying a set of objects 
into defective and nondefective Let the set consist of M objects where p is 
the probability that an object from the set is defective and q = 1 ~ p is the 
probability that the object is good Group testing consists of testing on a 
subset of this set A positive result of this test means that all objects of this 
subset are nondefective while negative result means that at least one of the 
objects IS defective 

One is interested in finding the optimal test strategy that minimizes the 
expected number of tests in classifying all objects No optimal strategy, 
however, is known Sobel and Groll [69] considered a restricted set of strategies 
known as nested strategies In a nested strategy, if the result of the test is 
positive at some stage, then the next test is done on a proper subset of the 
set which was tested at the previous stage The group testing algorithm 
described in this form lends naturally to its application in binary feedback 
of something/nothing kind For a ternary feedback model, the algorithm was 
slightly modified and applied for a finite user model with Bernoulli arrival 
process The steps of the algorithm are described in [85] Like Capetanakis's 
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tree algorithm, this algorithm also performs worse than TDMA for 7 ; > l/\/2 
The group testing algorithm, however, gives only a slight improvement over 
Capetanakis's optimum tree algorithm 


2.6 Random Access Systems with Multipacket 
Reception Capability 


In the previous sections, we have considered random access algorithms 
for the conventional random access system which can be modelled by the 
common receiver model discussed m Section 21 It was assumed there that 
simultaneous transmission of two or more packets results in collision and 
destroys all the transmitted packets In practical situations, however, because 
of the capture phenomenon, if the power of one of the received packets 
is sufficiently stronger than that of other packets, then the receiver may 
actually be able to correctly decode this packet Code division multiple access 
(CDMA) used in random access packet radio network is another example In 
CDMA-Random access system, the users encode their packets with pseudo- 
orthogonal codes When the encoded packets are transmitted simultaneously 
in a slot, then due to the pseudo-orthogonality of the codes, some packets 
may be received successfully The collided packets require retransmission and 
the users may employ some random access algorithm for rescheduling these 
packets Such systems are called random access systems with multipackel 
reception capability 


Conceptually at the macro level, such system can be considered to be a 
generalization of conventional random access system and can be represented 
by the conditional probabihty matrix [( 5 n,/t] where Qn^k is the probability that 
k packets are received successfully given n packets are transmitted m a slot 
Such a conceptual {n,k) channel was considered by Sylvie Ghez et al [24] 
In [47], [30], [61] a d-channel model of this system has been considered In 
this model, if more than d-packets are transmitted in a slot, all are destroyed 
But if less than d-packets are transmitted, then all packets can be received 

successfully This d-channel model is in fact a special case of {n,k) channel 

• ilHAL 
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model 

We have seen that though in an actual practical system, there will be 
many users, each with a transmitter and a receiver, trying to send messages, 
this system can be modelled by the common receiver model which has been 
discussed in detail in Section 21 In a generalized random access channel, 
however, there are various other factors which come into picture and the 
system model has to be considered at the macro level as opposed to the rniao 
level of conventional random access channel What follows therefore is the 
general description of this system model Our discussion below is with respect 
to CDMA-RA system 

2.6.1 CDMA-RA System Model 

In CDMA-RA system discussed here, we assume slotted operation Note that 
in conventional random access system, the slotted operation may increase the 
throughput of some random access algorithms For example, slotted ALOHA 
has double the throughput of unslotted ALOHA However, when CDMA is 
used in a network then because of the graceful degradation characteristics [82] 
of CDMA system, the difference in performance between slotted and unslotted 
system is not very significant [58] In such systems, to achieve reception of 
multiple packets, the packets are transmitted by encoding them with codes 
These codes are chosen from sets of codes with low cross-correlation properties 
The codes used to encode packets are called address codes Various schemes 
are possible for assigning these addresses These are. 

1 Transmitter Based Coding In transmitter based coding, each user is as- 
signed a fixed address code for transmission The user encodes its packet 
with this address code before transmitting it The different address codes 
are pseudo-orthogonal to each other Each receiver has the decoder for 
all address codes Instead of fixed address coding, random address cod- 
ing may also be used In random address codmg, each user's transmitter 
IS provided with a set of orthogonal codes The number of such codes is 
much smaller than the number of users in the system Each user before 
transmitting its packet, randomly chooses one of the codes and then uses 
It as its address If two or more users happen to choose the same code. 
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then their packets collide 

2 Receiver Based Coding In receiver based coding, a unique receiving code 
IS assigned to each user Any user which wants to send its packet to 
a particular receiver encodes its packet with the address code of thal 
receiver and then transmits If two or more users send packets to the 
same receiver simultaneously, the packets collide and are destroyed This 
collision IS called primary level interference Secondary level interference 
may also occur due to the pseudo-orthogonality of addresses of diflereni 
receivers 

Combination of the above schemes are also possible In transmitter based 
code assignment with hxed address codes, the source of a packet is usually 
identified by the address of the user In the case of random address codes 
used m transmitter based assignment and also in receiver based assignment, a 
packet may contam a header identifying the source of the packet The packets 
may also use some form of error correcting codes 

There are various types of address codes that can be used in CDMA-RA 
system One such scheme is pulse position tree coded multiple access (TCMA) 
The random access system using TCMA as the transmitter based codmg was 
analyzed by Raychaudhuri [60] In TCMA, each bit of the packet is encoded 
usmg a convolutional tree code of constraint length, say K The output 
symbols are one of the 2^ orthogonal pulses for every bit The bandwidth 
expansion factor then is 2^ The details of this scheme are given in [60] 
Goodman et al [26] and Einarsson [13] have proposed coding schemes that 
use some form of time-frequency coding These schemes can also be used as 
the address coding in CDMA-RA system 

The feedback information to the users about the collided packets is another 
important issue. In transmitter based coding, each user while transmitting 
the packet, may monitor the channel with this address Any possible collision 
can thus be detected In a system with common receiver, the receiver having 
decoders for all codes broadcasts the feedback information on a separate 
feedback channel This feedback informs users about the status on each code 
It is thus a form of multibit feedback In receiver based coding, the destination 
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receiver may senci acknowledgement signals to the transmitter which had sent 
the packet We now briefly examine below some of the schemes discussed in 
the literature 

2.6.2 Review of Random Access Algorithms for 
Multipacket Reception Channels 

If we assume that there are many users trying to send packets to a single 
receiver and these users employ transmitter based address coding with the 
receiver broadcasting the feedback on a separate feedback channel^ then this 
model IS a straightforward generalization of the common receiver model of 
Section 2 1 Accordingly in this section, we restrict our attention to this 
generalized common receiver model and review some of the random access 
algorithms considered for this model in the literature 

One of the first studies in CDMA-RA system was done by Raychaudhuri 
[60] Two types of multiaccess coding techniques, namely Time Hopping 
Multiple Access and Tree Coded Multiple Access, are considered for address 
codes These addresses are uniquely assigned to each transmitter The 
random access algorithm for the retransmission of collided packets is ALOHA 
algorithm Steady state throughput analysis was performed for this scheme 
The method of analysis is similar to that of ALOHA for conventional random 
access channel One of the important conclusions of this study is that with 
TCMA as the address coding, it is possible to achieve higher normalized 
throughput than that of ALOHA for normal channel The system is found to 
exhibit similar kind of stability behavior More importantly, the performance 
degradation of this CDMA-RA system for infinite user model with TCMA as 
the address coding is found to be more graceful m the sense that the delay does 
not increase as rapidly as in the normal ALOHA when the system is operated 
beyond the maximum stable throughput The system, however, exhibits the 
similar kmd of bistable channel behavior as is observed m ALOHA for a finite 
user model This system therefore needs appropriate control schemes The 
control schemes for such systems may not only depend upon choosing the 
proper retransmission probability but there are also other parameters like code 
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rate etc that can be varied These additional degree of freedom available add 
new dimension to the control problem 

Pursley [59] studied the performance of frequency hop transmission in 
random access system Sylvie Ghez et al [24] studied a generalized random 
access system This model is characterized by the probability matrix [Q,,,*] 
where Qn.fc is the probability that k packets are received successfully when n 
packets are transmitted Let C„ = kQn,k be the average number of packets 
successfully received when the number of packets transmitted is n Let the 
average arrival rate of packets be A Let Co = lini„_oo Cn (assuming this limit 
to exist) Suppose ALOHA is used as the random access algorithm for the 
retransmission of collided packets Then it was proved in [24] that the system 
is stable for all arrival rate distributions such that A < Co is unstable for 
A > Co If Co IS infinite, then the system is always stable The control scheme 
based on varying the retransmission probability was also considered by the 
authors in a subsequent paper [25] 

Random access algorithms employing collision resolution strategies were 
considered m CDMA environment by Hu and Chang [30] and Mehravari [47] 
Hu and Chang's work [30] can be considered as an extension of the tree 
algorithm to transmitter based address assignment scheme 
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An Optimal Collision Resolution 
Algorithm for Single Buffer Users 


In this chapter, we introduce the random access model which will be the 
model for our investigation The basic assumptions used in this model arc 
similar to those of the finite user model of Chapter 2 For this finite usei 
random access model, we focus our attention on the blocked random access 
algorithms As defined in Chapter 2, m a blocked random access algorithm, 
the users are prevented from transmittmg any new packet till the contending 
users have resolved their collisions using a collision resolution algorithm The 
time interval during which the contendmg users resolve their collisions is 
called the collision resolution epoch All communicating users are considered 
identical here and the users as decision makers follow identical decision rules 
to resolve collisions, if any These decisions are to be made in a decentralized 
way and the users share the common objective of utihzmg the channel as 
efficiently as possible This leads to formulatmg the problem of random access 
algorithm within the framework of decentralized team decision theory 

For a finite user model, we address ourselves the question of designing an 
optimal collision resolution algorithm in a blocked random access environment 
To facilitate our investigations, we assume that inihal colhsion multiplicity or 
the number of active users at the beginning of a collision resolution epoch is 
known This assumption, though somewhat restrictive, has been made here 
with a view to gam an msight into the problem It is relaxed m Chapter 
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4, where we consider a more general model However, as will be shown 
in this chapter, the assumption about knowing the number of active users is 
not a completely unreasonable one in practice Indeed this assumption has 
also been made by other authors [21, 55] in the context of different collision 
resolution algorithms 

Within the above framework, we identify an appropriate set of states and 
control variables that constitute a Markovian Decision Process (MDP) for the 
random access system It is then argued that the problem of optimal collision 
resolution algorithm is equivalent to the hrst passage problem of this MDP 
The dynamic programming technique is applied to derive an algorithm which 
is optimal m the sense of minimrzmg the expected time of termination or 
collision resolution epoch length when we know the number of active users at 
the beginning Finally, we consider the steady state operation of our system 
under this protocol and suggest an approximate method of estimating the 
steady state expected collision resolution length 

3.1 The System Model 

We consider the finite user common receiver model as shown in Figure 2.2 The 
following assumptions are made about this model Many of these assumptions 
are similar to those of Chapter 2 

1 There are N users in the system These users are addressed as 1,2, ,N 

2 Slotted Operation' The channel is assumed to be time slotted . The users 
can start the transmission of their packets only at the beginning of a slot 
The length of a slot equals the time required for the transmission of each 
fixed length packet We assume here that each time slot is of one unit 
duration 

3 Ternary Feedback If no packet is sent in a slot, then the channel is idle 
On the other hand, if only one user transmits its packet, then the packet 
IS successfully transmitted However, when two or more users try to 
send their packets simultaneously m a slot, these packets then collide 
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The users can distinguish between these three cases In other woids, it 
IS assumed that the users receive ternary feedback 0,1 or 2 depending 
upon whether the previous slot contained no packet, one packet or more 
than one packet respectively The feedback is assumed to be immediately 
available at the end of the slot It is also assumed that the feedback 
information is received errorless by all users 

4 Blocked Access Operation We assume that the users employ blocked 
random access algorithm In this model, the operation of the system can 
be divided into successive transmission intervals In each transmission 
interval, users resolve their collisions, if any, by using a collision resolution 
algorithm This transmission interval is called the collision resolution 
epoch The users are prohibited from transmitting any new packet that 
might have arrived durmg this epoch The packets generated in one 
epoch are transmitted in the next epoch Thus a collision resolution 
epoch ends, when all users have transmitted successfully their packets 
that were generated in the previous epoch 

5 Single Packet per Epoch We assume that each user can generate only 
one packet during a collision resolution epoch An alternative way of 
assuming this may be that each user has only two buffers The first 
buffer contains the packet which is undergoing resolution m the current 
epoch The second buffer contains any new packet that might arrive at 
the user during the epoch ^ All subsequent packets arriving after this 
packet which is stored in the second buffer, are lost At the end of 
the current epoch, packets m the second buffer are moved into the first 
buffer and are transmitted 

Let cr be the probability with which a user generates a packet in each 
slot during a collision resolution epoch If £ is the length of the collision 
resolution epoch, then the probability that a user has a packet at the 
end of the epoch will he p = 1 - {1 — aY For sufficiently small values of 
cr, even with large collision resolution length I, p can be assumed to be 

^Smce a user has only one buffer to store a new packet, it is usual to refer to this case as th( 
Single buffer 
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the probability of generating one packet (during the epoch Such packet 
generation mocJel has also been considere(d by Capetanakis [6] 

Although we have consiciered users with single buffers, we can still apply 
this scheme to users with infinite buffer capacity but with the restriction 
that each user is allowed to transmit only one packet per epoch A more 
efficient protocol in which users are allowed to transmit more than one 
packet per epoch can also be considered The steady state analysis under 
dynamic operation of this protocol for buffered users is considered in 
Chapter 5 

6 Active Users 

Definition 3.1 A user is defined to be an active user if it has a packet watting 
in its buffer for transmission 

We assume that the number of active users at the beginning of a collision 
resolution epoch is known to aU the users The users may acquire this 
mformation m the following ways 

(a) The common receiver may broadcast the mformation about the 
number of active users on a separate feedback channel (this channel 
may be a low data rate channel) 

(b) Alternatively, all users may be enabled initially The users will 
transmit their packets, if any If two or more users are active, it will 
result in collision The users are equipped with receivers having 
energy detectors With the help of energy detectors, the users 
measure the initial collision multiplicity or the number of active 
users 

Such an assumption has also been made by other authors in the literature 
[21] In either case, the users after knowing the number of active users, 
enter a collision resoluhon epoch 
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3.2 Random Access Algorithm for Finite User 
Model 

In the previous chapter, we have defined a random access algorithm for the 
finite user model Let us consider the set B{t) = /[*,:/, 0(f), 5^ (f)] = 1} 

where z is the user's address, le , i E {1,2, ,iV} and j is the index of the 
first packet of the user i at time instant t In other words, the set B{t) is the 
set of users allowed to transmit the first packets of their buffers at the time 
instant t Then as seen m Section 2 51, the random access algorithm foi a 
finite user model within the class Ay can be described by the sequence of sets 
{S(f),f = 0,l, } 

In this chapter, we want to consider those random access algorithms within 
the class Ay which employ the blocked channel access Thus we now need 
to consider only collision resolution algorithm to completely characterize our 
random access algorithm Accordmgly, we limit our attention to the operation 
of collision resolution algorithm during a single collision resolution epoch 
Further, as stated earlier, we assume that a user is allowed to transmit only 
one packet per epoch 

Let us now consider a particular collision resolution epoch The length 
of each slot is of one time unit as assumed earlier in Section 3 1 Then the 
collision resolution algorithm within that epoch can be specified by the set 
{B(t)} where B(t) = {z f[t, 0(f)] = 1}, f G / = {0, 1, } and f = 0 denote the 

beginning of the collision resolution epoch under consideration Our interest 
in this chapter is in the design of function / which characterizes the collision 
resolution algorithm This function in effect specifies the set of users allowed 
to transmit their packets at each stage For this, we first study the dynamics 
of the system in the following section 
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3.3 Dynamics of the System 

3.3.1 The System State 

Definition 3.2 A user is said to have been resolved if one of the following conditions 
IS obtained 

1 All other users know that the user does not have a -packet 

2 The user was enabled in a slot that was either empty or successful 

Note that the second condition implies that although the identity of the 
user having a packet does not become known to other users, all those useis 
which were enabled in a slot that resulted in a success are treated as resolved 
A user which is not resolved, is treated as unresolved We now define the 
state of our system as follows 

Definition 3.3 The state of the system at the instant t is defined to be a two tuple 
S{t) = [N{t),n(t)], where 

N(t)= Number of unresolved users at time t 
n(t) = Number of active users at time t 

Since at the beginning of the collision resolution epoch, all users in the 
system are unresolved, we have N{0) = N If the number of active users a1 
the beginning of the epoch is some number say n, le , n(0) = n, then the 
initial state is S{0) = (N,n) Note that (0,0) is the state at which all users are 
resolved By definition therefore, the collision resolution epoch ends when the 
state (0, 0) IS reached. In our model, the initial state 5(0) = (AT, n) is assumed 
to be known to all users 

3.3.2 Enumeration of the States 

Let S denote the set of all possible states Let the number of possible states 
be denoted by C We then have the following proposition 
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Proposition 3.1 If N is the total number of users in the system, then the total 
number of possible states will be C = N(N + l)/2 + 1 

Pi oof The proof is straightforward and omitted here 

Let Si = (iVj, nf) denote the zth state Here may be any number from 0 to 
N and n, < Thus the state space S = {5], 52, , Sc}, where 5i = (Nun-i), 

S 2 = (^^ 2 ,^- 2 ) and so on If the number of users m the system is N = 8, then 
the possible states are listed in Table 3 1 (state (0,0) is not listed) 

The evolution of this system state with respect to a collision resolution 
algorithm is discussed in the next subsection 

3.3.3 Evolution of the System State 

A collision resolution algorithm can be defined as a control policy which 
comprises a sequence of actions to be taken at each stage and each such 
action, specifies the set of users to be enabled for transmission at that stage 
This control policy may depend upon the state and the history of the system 
If the number of unresolved users is N^, then the pohcy can be described as 
specifying at each stage an identical JV, dimensional vector which is used by 
all users at that stage Each element of this vector assumes binary values ol 
either 0 or 1 If the ith element of this vector at any stage is 1, then the 
corresponding user is allowed to transmit at that stage 

The control policy considered m this chapter gives the optimum number of 
users to be enabled at each stage Let {S(t),t = 0,1, . } denote the sequence 
of observed states Similarly let {u(t),t = 0,1, } denote the sequence of 

control actions taken Thus the control u(t) here specifies the number of users 
to be enabled during slot (t,t + 1) Let U{S{t)) denote the set of admissible 
control actions at time t We will also use the notation U{St) to denote the 
set of admissible control actions when the state is 5, = (Ni,ni) Since JVj is 
the total number of users to be resolved, the set of admissible control actions 
when the state is S^ will be {0,1, ,Ar,} 

If the number of unresolved users is AT,, then there will be exactly pos- 
sible control vectors for control u The users may agree upon a predetermined 
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protocol to decide upon the particular vector so that each user chooses the 
same vector at its site The users may use a pseudorandom number generator 
with the same seed to choose the vector 

Assume that at the instant t, S{t) = 5, = where n., > 2 and control 

v{t) = u If now V users are enabled and an empty feedback is observed then 
it is known that the enabled v users do not have packets and they are said to 
be resolved, so that the next state S{t + 1) moves to {N^ — u, n,) On the other 
hand, if v users are enabled to transmit and it results in success, then the next 
state IS {N^ — u,n^ — 1) However, if this action results in collision, then no user 
IS resolved and the next state S{t + 1) continues to have the same value as 
that of S(t) 

On the other hand, assume now that rij = 2 and all users have perfect 
knowledge of the state (iVi,n,) If now collision takes place by enabling u 
users, then the users would come to know that the remaining (A, — u) useis 
do not have packets, so they can be treated as resolved and the next state 
is (u,2) If however, an empty feedback is observed, then the next state is 
(AT, - u, 2) and if a success is observed, then the next state is {N^ — u, 1). 

Remark 3.3.1 We note that if the state S{t) is known perfectly, then by 
observing the feedback + 1) and the control action it(f), the users can have 
perfect knowledge of the state 5(f + 1) Since the initial state 5(0) is assumed 
to be known to all users, it follows that users have perfect knowledge of the 
state at every stage 

Remark 3.3.2 We also note that the probability of transition from the present 
state S(t) = 5, = {N„n^) to the next state S(t + 1) = 5^ = (Nj^Uy) depends 
only upon the state 5(f) = 5, = {N„n^) and the control action u{t) = u The 
following proposition can thus be stated 

Proposition 3.2 For a given sequence of control actions, u(0), u(l), . , u(t), the 
sequence {5(f), f £ 1} is a Markov chain, le, 

Proh [5(f + 1) = 5, I 5(f) = 5., u(f) = u, 5(f - 1), u(t - 1), , 5(0), u(0)] = 

Prob [5(f + 1) = 5^ I 5(f) = 5,, u(f) = v] (3 1) 
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Let us denote this one step state transition probability by ^ {v) Let 

P{v) = p^ ^ (u) denote the state transition probability matrix with elements 
p (u) foTS^,SJ e S 

As defined in [11, 5, 64] Markovian Decision Process is a class of Stochastic 
Sequential Decision Processes where the transition probability function depends 
only upon the present state and the present control action Thus the stochastic 
process {S{t),v{t),t G /} is a Markovian Decision Process The control v{i) 
may depend upon the entire history of the system If the control u{t) depends 
only upon the state 5(f), then clearly the sequence {5(f),ti(f),f G /} is a 
Markov chain Finally, we can conclude our discussion of this subsection in 
the following proposition 

Proposition 3-3 The finite user random access model of Figure 2 2 is completely 
characterized by 4-tuple {S,U,S(0) = (AT, n), {P(u), Vu G ZY}} together with the 
property 3 1, where S is the finite state space, U is the collection of the sets of 
admissible control actions for all states, le , U = {U{SffiSi G 5}, Pfu) is the state 
transition probability matrix when the control applied is u, {P(u)} is the collection of 
such probability matrices and 5(0) = (AT, n) is the initial state assumed to be known 
to all the users at the beginning of the collision resolution epoch 

3.3.4 Evaluation of State Transition Probabilities 

In this section, we calculate the probability p^ ^ (u) of transition from the state 
S, = (Ar„n,) to another state 5^ = (Ar_,,n^) when control action u is employed 

Let the state at any instant be 5, = (AT,, n^) where n, > 2 If control u is 
applied, then the next state can be either (TV,, n,) or (TV, - u, n,) or (TV, -u,n^- 1) 
The transition from (TV„n,) to (TV, - u,n,) occurs when by enabling u users, 
chosen randomly from amongst TV, users, an empty feedback is observed 
Similarly, the transition from (TV„n,) to (TV, - u,n, - 1) occurs, when success is 
observed, i e , among the enabled u users, only one user had a packet The 
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probabilities of state transition for n, > 2 are given by the following relations 

(;)("”) 




yc- 0 




(3 2) 


(3 3) 


However, if among the enabled v users, two or more users have packets 
then none of the users are resolved We thus have 


I v\ fNt-u 


(3 4) 


The probability of transition from {N^,n^) to all other states will be zero 
This fact can be expressed as 

PfM ^ 7 K' ^(^) = 0 for Nj f iV, or (W - u) and ^ n, or (n, - 1) (3 5) 

If n, = 2, then the next state can be {N^ — u, 2) or (W, — u, 1) or (u, 2) The 
state transition probabilities from the state (^,,2) to (AT, — u,2), (iVj — u,!) and 
(tt,2) are given as follows 

_ (:)(V) 




l)(\“) 






G) 

(N. 
\ ( 

r) 

1 

(^■) 

1 


(3 6) 

(3 7) 

(3 8) 


In the above equations, it was assumed that N^ — u 7^ u However, if AT, — u — u, 
then the next state can only be («, 2) or (Ar,-u,l) The probability of transition 
from (W, 2) to (iV,-u, 1) will be the same as above but the transition probability 
from the state (W,,2) to (u,2) will be given by 


^]iV 


p (u) = 2 ■ y -fT 

^ (7V,,2),(u,2)^ ' fA. 


(3 9) 
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Let # be an admissible control policy which specifies a control action 
corresponding to each state The policy ^ may specify some control (say 
V G U{Si)) to be applied when the state is 5, We then have the following 
theorem. 


Theorem 3.1 Let ^ ^ denote the k-step state transition probability from 

(TV,,?!,) to ( 0 , 0 ) when controls at various stages are specified by the policy te , 


^W,n.),(o,o)(^^ = Pro6[5(^) = (0,0) I 5(0) = (W„n,), #] 


(3 10) 


^ ^ /c > 1 V5, = {Nr, Ur) € 5 

Proof The A--step transition probability {€>) can be written as 




p' ' (^) = Y' p (^)p^^ (#) 


(311) 


Assume that an admissible control u( 0 ) = u is applied at the time t ~ 
0 Since the state 5(0) = (iVj,nj), the set of admissible controls will be 
{0,1, ,Nr} Then the next state moves to some other state Sj = {Nj,rij) 
From the expressions for the state transition probabilities, we know that Sj 
has the nonzero probabihty of being one of the following states (iV,,nj),(iVj - 
1, n,), . , (n,, n,), (A/, - 1, n, - 1), (A, - 2, n, - 1 ), , (n, - 1, n, - 1) dependmg upon 

the control specified by the policy If Sj = (0,0) then ^^^^^(^) = 1 for 
k = 1. However, if Sj 7 ^ ( 0 , 0 ) then the control corresponding to the state Sj 
IS applied at the stage. It follows easily that ultimately we can reach the state 
( 0 , 0 ) in some finite number of steps k and the fc-step transition probability 
can be calculated in a recursive manner by Equation 3.11 □ 


Remark 3.3.3 For a given control policy, we may represent the state transi- 
tions at various stages by a graph in which nodes may correspond to the states 
and a directed arc from one node to another node represents the transition 
from one state to another state, when control action corresponding to the state 
as specified by the policy is applied If ^ (u) = 0, then there will be no 
path from the node 5, to the node Sj Then what the theorem states is that 
there exists a path from every possible initial state to the state ( 0 , 0 ) for any 
admissible control policy 
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3.4 The Optimal Collision Resolution Algorithm 

We are now in a position to formulate the problem of optimal collision 
resolution algorithm The length of a collision resolution epoch is called the 
collision resolution length The collision resolution algorithm is a control policy 
and the optimality criterion used is the expected collision resolution length 

The policy derived here gives the optimum number of users to be enabled 
at each stage Any such control policy or strategy can be defined to be a set 
of functions 

where [u | H(t — 1), S{t)] is the probability with which u users are enabled 
at time i given the past history H{t — 1) and the state of the system S(t) The 
past history may consist of the past states and control actions, i e , 

H(t - 1) = {S(0), «(0), S(l), n(l), , S{t - 1), - 1)} (3 12) 

Since given the initial state, the users have perfect knowledge of the state 
at subsequent stages by observmg the feedback and the control, the history 
vector H{t — 1) can be written as 

H{t - 1) = {S(0), n(0), 0(1), u(l), 0(2), , u{t - 1)} 

If our strategy is such that the function (j) is independent of time t and the 
history of the system H(f — 1), but depends only upon the value of the present 
state S(t), then such strategy is called a deterministic and stationary strategy 
For (j)t [u(f) = u I H{t - 1), S{t)] to be deterministic and stationary function we 
have 

(t>t [u(f) = u\H{t- 1), S{t) = S,] = <t> Iw(i) = u I S{t) = S^] 

Thus (j) <S I— > 1/ IS a smgle valued map from the state space to the control 
space Our deterministic and stationary policy # will be given by 

Let T’/) = {#} be the class of all such determmistic stationary policies We 
will see in Section 3 4 2 that our optimal policy belongs to this class This 
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optimal policy specifies the number of users to be enabled for each state As 
already explained, the precise set of users is to be chosen randomly After the 
addresses of the users to be enabled have been determined, the function /[ J 
characterizing our collision resolution algorithm is completely specified 


3.4.1 Statement of the Problem 


We first introduce a cost structure into our model Suppose a policy ^ = 
{<?^o[ ], ]i } IS used After observing the state S(t), which may be equal 
to Si = (A/,, Hi), an action u (specified by the policy) is taken This state then 
undergoes a transition to the state S(f + 1) = 5^ = {Nj,n^) We assume that 
an incremental cost + 1) = Sj,S{i) = Si,u{t) - u) is incurred with this 

transition Define the following expected cost 


' = x; xP{S{t + 1) = S{t) = Sii u(t) = u)p^ ^ (u{t) = u) (3 13) 

Let ^(S{t),u{t)) denote the cost incurred at time t Then v) 

if at the instant t, the control u(t) = u and the state S{t) = 5, = {Ni,ni) 

The total expected cost of operating the system up to the time f = r given 
that the mitial state is S{0) = (N, n) and the policy used is # is then given by 


C^A^iO) = (AT, n)) = E 




lt=0 


= S P'^ob[S(t) = Si,u(t) = u I S'(O) = (W,n)] 

t=0 S,e5 u&i{S,) 

nS^ = iNllnl),u) (314) 


The problem of optimal collision resolution algorithm is as follows 
Define the cost ^ as follows 

!f'(S'„u) = 1 VS', G 5 except for the state (0,0) 
and !A((0,0),ix) = 0 , ^ ' (315) 

Let T be the time instant when for the first time the state (0, 0) is reached, t e , 
S(t) = (0,0) and S{t) f (0,0) for f < r When the state (0,0) is reached, then 
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all users are resolved and the collision resolution epoch ends Assume that 
P(oo)(oo)(^) = 1/ * if the system reaches the state (0,0), it remains there for 
any policy We can then remove the dependence of the cost function on 
r and write the expression for it in the following form 


C^{S{0) = (A,n)) = E 




T-0 


“TEE ProHS{t)=S„u{t) = n\S(0) = (N,n)] 

t~0 St^S u^^{St) 

nS^ = {N,,n,),u) 


(3 16) 


Then the above cost C^(S(0) = (A, n)) gives the expected collision resolution 
, length We are interested in collision resolution algorithm which minimizes 
the expected collision resolution length In other words, our interest is in 
policy which minimizes the expected time to reach the target state (0,0) We 
immediately see that the problem is equivalent to the optimal first passage 
problem of a Markovian Decision Process [11] 


3.4.2 Existence of Optimal Collision Resolution Algorithm 

As the problem of optimal collision resolution algorithm is equivalent to the 
first passage problem of a Markovian Decision Process, we can show that there 
exists an algorithm which is optimal This optimal algorithm is a stationary 
deterministic policy 

Let 3^ denote the class of all possible policies having dependence upon 
the entire history of the system Let denote the subclass of stationary 
deterministic policies (i e , y? C y) In a policy belonging to this subclass, the 
action at the time t depends only upon the state of the system at the time t 
and the policy defines a single valued transformation from the state space to 
the control space We then have the following theorem 

Theorem 3.2 Let the initial state be S{0) = (N,n) We define the cost structure 
as given in Equation 3 35 Since ^^^^^(^) > 0 for some k > 1, there exists an 
optimal policy G y^i such that ^ minimizes the expected collision resolution 
length C^(S(0) = (N,?i)) 
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Proof This theorem is an obvious generalization of the existence theorem 
of the optimal first passage problem proved in [11] This proof is given in 
Appendix A □ 

Let this optimal expected collision resolution length be denoted by 
t e , L^iN,n) = C^(5(0) = {N,7i)) 


3.4.3 Determination of Optimal Collision Resolution Algo- 
rithm 


In this section, we show how to determine an optimal collision resolution 
algorithm using dynamic programming techniques We have the following 
theorem which enables us to compute the optimal policy iteratively 

Theorem 3.3 Let Vq(Si) = 0 V5j G [{<S} — (0,0)] Define the following 




mm 

U6?V(S.) 


ns.,u)+ Y: («)K.(S;) 


2>J#(0,0) 


(317) 


then lim,n-oo V',n(S',) = C^*{S{0) = (Ar„n,)) = L%N^,n,) where 6 yD minimizes 
C^(S(0) = (N,n)) 


Proof This theorem can be proved as in [11] and is given in Appendix A n 

Similar to Remark 3 3 3, the state transitions at various stages may be 
represented by a graph m which the nodes may correspond to the states The 
different outgoing arcs from a node may correspond to the controls admissible 
at the corresponding state The length of an arc from one node to another 
may correspond to the cost per stage The problem of finding an optimal 
collision resolution algorithm is then equivalent to finding the shortest path 

For a given initial state, we can iteratively solve Equation 3 17 and compute 
the expected collision resolution lengths L%N, n) and the optimal control actions 
u* corresponding to the possible states 
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Numerical Results 

For illustration purposes, consider N = 8 and N = 16 users For AT = 8, the 
number of active users at the beginning of an epoch may vary from 1 to 8 
The various possible states are given in Table 3 1 The possible initial states 
will be (8,1), (8,2), ,(8,8) We compute the state transition probabilihes for 

all states using Equations 3 2 to 3 8 We then iterate according to Equation 
3 17 The iteration is stopped when the following condition is satisfied 

|K,+i(50-y„,(50|<lxlO-' €<s 

Thus we get the values of expected collision resolution lengths correct up 
to three decimal places Table 3 1 gives the expected collision resolution length 
and the corresponding optimal control action for each possible state for N = 8 
Similarly, for W = 16, the optimal control actions for various states are given in 
Table 3 2 In Table 3 2, those states which have already been included m Table 
3 1 are not shown The expected collision resolution lengths for all possible 
initial states when the total number of users is 8 and 16, are shown explicitly 
in Table 3 3 and 3 4 respectively 

We note from Table 3 1 that when the number of active users at the 
beginning of a collision resolution epoch is 8, the optimal control pohcy leads 
to enabling each user separately This is nothing but TDMA which is obviously 
the best way to transmit when all users have packets For other initial states, 
the algorithm performs better than TDMA 

In actual practice, since the users know the inital state, they have perfect 
knowledge of the state at every stage by observing the feedback and the control 
action The users can determine the optimal control action corresponding to 
the state from the look-up table This action specifies the number of useis 
allowed to transmit their packets Corresponding to this number, there will 
be many possible sets of users that can be enabled. The users arrive at a 
particular set by using a pseudorandom number generator with the same seed 
The enabled users transmit their packets, if any This procedure is continued 
till all users are resolved 
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3.5 Steady State Average Collision Resolution 
Length 

In this section, we perform the steady state analysis of our collision resolu- 
tion algorithm The system operation can be divided into successive collision 
resolution epochs We assume that packets arrive to each user according to 
a Bernoulli process Let a be the probability with which a user generates a 
packet in each slot But since the user has only one buffer to store a packet, 
the remaining packets are assumed to be lost At the beginning of a collision 
resolution epoch, all users know the number of active users Alternatively, all 
users are enabled initially If no or only one user is active, then the collision 
resolution epoch consists of only one slot In the event of a collision, the users 
measure the colhsion multiplicity as in Section 3 1 and come to know of the 
number of active users at the beginning of the collision resolution epoch 

Let £, denote the length of ith collision resolution epoch Then the proba- 
bility that a user has a packet at the beginning of (i -I- l)th collision resolution 
epoch will be given by 

= 1 - (1 - aY‘ (3 18) 

Note that 4 is a random variable and hence p varies from epoch to epoch 

Assuming that steady state conditions are obtained, the above expression 
can be written as 

p = 1 - (1 - ct)^ (3 19) 

where L denotes the steady state average collision resolution length and p 
the steady state probability of having a packet by a user Let p„ denote the 
probability that n users are active out of N users i e , 

Pn= (3 20) 

Then L can be computed by the following expression 

L=YL\N,n)p,, (3 21) 

n=0 
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The value of L can be calculated iteratively Let L{k + 1) be the value ol 
X at (A- + l)th Iteration Then using Equations 3 19 to 3 21, we can write the 
following 

V"/ 

where p(k) = 1 - (1 - (t)^^ (3 22) 

To begin with, initially, L(0) can be taken as the arithmetic mean, le, 
■^(0) =" Z)^=o n)/i\A The iteration is stopped when the following condition 
IS satisfied 


|X(A- + 1)-X(A-)| < e 

lp(k + 1) - p(k)l < € 

where e is the specified value 

To illustrate the above case, we take the number of users AT = 16 Note that 
under the steady state operation, we have L^^iN, 0) = L‘^(N, 1) = 1 The values 
of L%N,n) for n > 2 are given in Table 3 4 For these values, we perform 
the Iteration of Equation 3 22 for the different values of a till the convergence 
IS achieved up to three decimal places The steady state average collision 
resolution lengths and the steady state probabilities of having a packet at 
the beginning of the epoch for different values of arrival probabilities a are 
tabulated in Table 3.5 
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Table 3 1 Optimal Control Values for Possible States for Af = 8 


State 

Optimal 

Control 

Expected Collision 
Resolution Length 

(8,1) 

8 

1 000 

(8,2) 

4 

2 571 

(8,3) 

2 

4 189 

(8,4) 

2 

5 471 

(8,5) 

2 

6 688 

(8.6) 

2 

7 357 

(8,7) 

1 

7 750 

(8,8) 

1 

8 000 

(7,1) 

7 

7 000 

(7,2) 

3 

2 571 

(7,3) 

2 

4 lOO 

(7,4) 

2 

5 360 

(7.5) 

2 

6 238 

(7,6) 

1 

6 714 

(7,7) 

1 

7 000 

(6,1) 

6 

6 000 

(6,2) 

3 

2 533 

(6,3) 

2 

3 875 

(6,4) 

2 

5 066 

(6,5) 

1 

5 666 

(6,6) 

1 

6 000 

(5,1) 

5 

1 000 

(5,2) 

2 

1 

2 500 

(5,3) 

2 

3 800 

(5,4) 

1 

4 600 

(5,5) 

1 

5 000 

(4,1) 

4 

1 000 

(4,2) 

2 

2 333 

(4,3) 

1 

3 500 

(4,4) 

1 

4 000 

(3,1) 

3 

1 000 

(3,2) 

1 

2 333 

(3,3) 

1 

3 OOO 

(2,1) 

2 

1 000 

(2,2) 

1 

2 000 

(1,1) 

1 

1 000 
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Table 3 


Optimal Control Values for Possible States for AT = 16 


State 

Optimal 

Control 

Expected Collision 
Resolution Length 

(16T) 

16 

1 000 

(16,2) 

8 

2 733 

(16,3) 

5 

4 603 

(16,4) 

4 

6 326 

(16,5) 

3 

7 985 

(16,6) 

3 

9 504 

(16,7) 

2 

10 825 

(16,8) 

2 

12 080 

(16,9) 

2 

13 256 

(16,10) 

2 

14 222 

(16,11) 

2 

14 839 

(16,12) 

2 

15 235 

(16,13) 

2 

15 510 

(16,14) 

2 

15 716 

(16,15) 

2 

15 875 

(16,16) 

1 

16 000 

(15,1) 

15 

1 

1000 

(15,2) 

7 

2 733 

(15,3) 

5 

4 567 

(15,4) 

4 

6 293 

(15,5) 

3 

7 864 

(15,6) 

2 

9 358 

(15,7) 

2 

10 646 

(15,8) 

2 

11858 

(15,9) 

2 

12 941 

(15,10) 

2 

13 696 

(15,11) 

2 

14 158 

(15,12) 

2 

14 469 

(15,13) 

2 

14.695 

(15,14) 

1 

14 866 

(15,15) 

1 

15 000 
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Continued- 


State 

Optimal 

Control 

Expected Collision 
Resolution Length 

(14,1) 

14 

1 000 

(14-2) 

7 

2 725 

(14,3) 

5 

4 526 

(14,4) 

3 

6 232 

(14,5) 

3 

7 776 

(14,6) 

2 

9155 

(14,7) 

2 

10 416 

(14,8) 

2 

11 599 

(14,9) 

2 

12 513 

(14,10) 

2 

13 063 

(14,11) 

2 

13 419 

(14,12) 

2 

13 670 

(14,13) 

2 

13 857 

(14,14) 

1 

14 000 

(13,1) 

13 

1000 

(13,2) 

6 

2 717 

(13,3) 

4 

4 482 

(13,4) 

3 

6146 

(13,5) 

3 

7 658 

(13,6) 

2 

8 993 

(13,7) 

2 

10 203 

(13,8) 

2 

11274 

(13,9) 

2 

11944 

(13,10) 

2 

12 358 

(13,11) 

2 

12 641 

(13,12) 

2 

12 846 

(13,13) 

1 

13 000 
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Continued- 


State 

Optimal 

Control 

Expected Collision 
Resolution Length 

(12,1) 

12 

1 000 

(12,2) 

6 

2 697 

(12,3) 

4 

4.420 

(12,4) 

3 

6 041 

(12,5) 

2 

7 491 

(12,6) 

2 

8 757 

(12,7) 

2 

9 955 

(12,8) 

2 

10 793 

(12,9) 

2 

11284 

(12,10) 

2 

11 606 

(12,11) 

2 

11833 

(12,12) 

1 

12 000 

(114) 

11 

1000 

(11,2) 

5 

2 690 

(11,3) 

3 

4 397 

(114) 

3 

5 953 

(11,5) 

2 

7 351 

(11,6) 

2 

8 563 

(11,7) 

2 

9 595 

(11,8) 

2 

10 191 

(11,9) 

2 

10563 

(11,10) 

1 

10 818 

(11,11) 

1 

11000 

(10,1) 

10 

1000 

(10,2) 

5 

2 666 

(10,3) 

3 

4 341 

(10,4) 

2 

5 837 

(10,5) 

2 

7106 

(10,6) 

2 

8 322 

(10,7) 

2 

9 071 

(10,8) 

2 

9 511 

(10,9) 

3 

9 800 

(10,10) 

1 

10 000 
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Contmued- 


State 

Optimal 

Control 

Expected Collision 
Resolution Length 

(94) 

9 

1000 

(9,2) 

4 

2 638 

(9,3) 

3 

4 238 

(9,4) 

2 

5 719 

(9,5) 

2 

6 947 

(9,6) 

2 

7 911 

(9,7) 

2 

8 444 

(9,8) 

1 

8 777 

(9,9) 

1 

9 000 


Table 3 3 Expected Collision Resolution Length for iV = 8 


State 

Expected Collision 
Resolution Length 

(8,1) 

1000 

(8,2) 

2 571 

(8,3) 

4189 

(8,4) 

5 471 

(8,5) 

6 888 

(8,6) 

7 357 

(8,7) 

7.750 

(8,8) 

8 000 
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Table 3 4 Expected Collision Resolution Length for N = 16 


State 

Expected Collision 
Resolution Length 

(16,1) 

1000 

(16,2) 

2 733 

(16,3) 

4 603 

(16,4) 

6 326 

(16,5) 

7 985 

(16,6) 

9 504 

(16,7) 

10 825 

(16,8) 

12 080 

(16,9) 

13 256 

(16,10) 

14 222 

(16,11) 

14 839 

(16,12) 

15 235 

(16,13) 

15 510 

(16,14) 

15 716 

(16,15) 

15 875 

(16,16) 

16 000 


Table 3 5 Steady State Average Collision Resolution Length for N = 16 


Arrival 

Probability 

a 

Steady State 
Probability 

P 

Average Collision 
Resolution Length 
L 

0 01 

0 01 

1024 

0 02 

0 022 

1095 

0 03 

0 037 

1253 

004 

0 07 

1 774 

0 05 

0 39 

9 492 

0 06 

0 54 

12 439 

0 07 

0 63 

13 878 

0 08 

0 70 

14 635 

0 09 

0 76 

15 064 

010 

0 80 

15 330 

0 20 

0 97 

15 937 

1 00 

1 00 

16 000 





Chapter 4 

Suboptimal Collision Resolution 
Algorithms 


In Chapter 3, we have assumed the number of active users at the beginning 
of the collision resoluton epoch to be known and derived an optimal collision 
resolution algorithm that minimizes the length of the collision resolution epoch 
for blocked channel access 

Although the number of active users at the beginning of a collision res- 
oluhon epoch can be known in practice through the mechanism explained 
m Section 3 1, we would like to consider a more general situahon where the 
number of active users may not be known but the probability distnbuhon over 
the initial states is given If the packet arrival probability to each user is known, 
then the probability distribution over the initial states can be calculated 

For such a general model, we pose the question whether an optimal collision 
resolution algorithm can be derived We argue in this chapter that the probability 
distribution over the states conditioned on the past informahon constitutes 
the appropriate new state description for this problem The problem oi 
ophmal collision resolution algorithm may then be viewed conceptually as 
the first passage problem of a Parhally Observable Markovian Decision Process 
(POMDP) The ophmal collision resoluhon algorithm can be derived in principle 
but the implementation of such an algorithm is computationally burdensome 
and therefore we look for reasonably good suboptimal algorithms which can be 
easily implemented in prachce 
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We suggest in this chapter two suboptimal collision resolution algorithms 
One of these suboptimal algorithms- SOAl chooses control actions based on 
the state having maximum probability of occurrence while another suboptimal 
algorithm- SOA2 chooses control actions based on the expected state The 
performance of these algorithms is studied by simulations 

The expected collision resolution lengths for various probability distribu- 
tions due to the two suboptimal algorithms is compared with corresponding 
bounds on the optimal expected collision resolution lengths We show that 
the degradation in performance due to these suboptimal algorithms is not 
significant for practical purposes 

Finally, we study the behavior of these two algorithms in the presence of 
feedback error We discuss a feedback error model due to Massey and perform 
the simulations of our suboptimal algorithms under this model The results 
of these simulations are presented in the end 


4.1 General Finite User Model 

4.1.1 Basic Assumptions 

Most of our assumptions are the same as those of Chapter 3 Following the 
notations of Chapter 3, N represents the total number of users m the system 
The packets generated in one collision resolution epoch are transmitted in the 
next epoch As before, we assume that a user can generate only one packet 
during a epoch In other words, we may assume that each user has only one 
buffer to store a new packet during the epoch 

The users can start the transmission of their packets only at the slot 
beginnings We call the slot containing only one packet as the successful slot 
and more than one packet as the collision slot At the end of each slot, the 
users receive ternary feedback 0, 1 or 2 depending upon whether the slot was 
empty, successful or collision slot Let the slot beginnings withm a collision 
resolution epoch be denoted by t where tel and J = {0,1,2, } 

Let N{t) and n(t) be the number of unresolved users and the total number 
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of active users, respectively, at time t Then the state of our system at the 
time t, as defined in Chapter 3 and denoted by S{t), is given to be two- 
tuple [N{f),'n{t)], le, S{t) = [N(t),n(t)] Clearly N(0) which is the number ol 
unresolved users at the beginning of a epoch is equal to N Similarly let n(0), 
which IS the number of active users at the beginning of the epoch, be equal 
to n However, unlike the assumption made in Chapter 3, here the number 
of active users at the beginning of the epoch is not known 

We assume that, instead of the number of active users being known, 
the probability distribution over the initial states is given If N is the total 
number of users in the system, then the number of possible states will be 
£ = N(N + l)/2+ 1 Let the state space be 5 = {S'), 52, ,5£} The elements 

of the state space are denoted by 5, where 5, = (iV^,n,) and < N and 
n, < N^ 

Let the initial probability distribution vector be denoted by P(0), where P(0) 
is given by 

^^0) = [p..(0),p,,(0), ,p,J0)] 

Here ^^^(0) = Prob[S{0) = 5i], i e , is the probability that the state at the 
beginning of the epoch is some two-tuple Si = (Ni,ni) 

As in Chapter 3, ZY(5,) denote the set of admissible control actions, when 
the state is 5, The control action specifies the number of users enabled for 
transmission When a control action is employed at the instant t, the state 
5(f) = 5, moves to the state 5(f + 1) = 5, with probability p {u) and a 
feedback 6(t + 1) is observed by all users The feedback 9{t + 1) belongs to an 
observation space 0 = {0,1,2} 

4.1.2 Dynamic Evolution of the System 

With above assumptions, our general random access model may then be 
represented as shown in Figure 4 1 The feedback output 9{t) depends prob- 
abilistically on 5(f - 1) and u{t - 1) Similarly, the state 5(f) = [N{t), n(f)] 
depends probabilistically on 5(f — 1) and u{t — 1) Thus our system model 
IS essentially a Finite Probabilistic System (FPS) introduced by Platzman [57] 
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Figure 4 1 Representahon of Finite User Random Access Model 

Since both the state S{t) - [N{t), n(f)] and the feedback observation 6(t) depend 
probabilistically on S(t-1) and ti(< — 1), the pair [S{t),6(t)] is a random variable 
which depends jointly on [S{t — 1), u{t — 1)] Thus the dynamic evolution of 
the system can be described by the probabilities of the state and the feedback 
values conditioned on the previous state and the control 

As shown by Platzman [57], FPS is a generalization of Markov Cham and is 
equivalent to a Markov Decision Process (MDP) whose state at time t consists 
of the pair [S^(f), 0{t)\ Such a process is called a Partially Observable Markovian 
Decision Process 

Similar to FPS, the dynamic evolution of our system can be summarized 
in the following terms 

1 The stochastic process consisting of the sequence of states {S{t) = 
[N(t),n{t)], t e 1} is called the core process For a given sequence of 
control actions, it is a finite state Markov Cham This chain is completely 
characterized by the state transition probability matrix P{u) = p„ „ (fj) 
The state transition probabilities can be calculated from Section 3.3 4 

2 The core process {S(t), t E 1} is not directly observable The initial state 

S{0) assumes value with probability p^ (0) 

3 The stochastic process f G /} is called the feedback process 

4 When the control u{t) = u is applied at time t, te , when u users are 
enabled at time t, the state S(t) = S^ undergoes a transition to the state 
S{t + 1) = Sj with probability p (n) and feedback 9(t + 1) = 6 with 
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6 £ {0,1,2} IS observed with probability p{9 \ S„u) 


4.1.3 The Conditional Probability Distribution of the State 

The information vector at any instant t is defined as the data available to all 
users for making decision at the instant t This data consists of all the past 
feedback observations and the control actions Let this vector be denoted by 
J(f) Then I{t) is given by 


m = {9(11 0(2), , 9(t), u(0), n(l), , u(t - 1)} 


The followmg result can then be established 


Theorem 4.1 The conditional probability of the state can be recursively computed 
by the following expression 


p[S(t + l) = Sr\I(t+l)] = 


Es.es,Ps^^s^^)p[S(t)\m] 

'Ls,es'Ls.€So Pg, sS'^)p[S(t) I I(t)] 


(4.1) 


where Sg is the set of all states 5, such that 


p[9(t + 1) = 9\ S(t) = 5„S(i + 1) = Sr,u(t) = u] = 1 


and p „(u) = p [S(f + 1) = 5; | S(t) — S',, u(t) = u] 

Proof We note that J(f + 1) = {0(1), 0(2), ,0(t + l),u(0),tt(l), . ,u(f)} We 

then have 


p [S(t + 1) = Sr \ I(t + l)]=p [S(t + 1) = S, I I(t), 9(t + 1), u(t)] (4 2) 


By applying Bayes' rule we can write 


p[5(f + 1) = 5. I I(t + 1)] 

^ p[9(t + 1) I S(t + l)J(t),u(t)]p[S(t + 1) I m,u(t)] 
p[e(t+l)\I(t),u(t)] 

E Pg g (u)p[S(t) I I(t)]p [9(t + 1) I S(t + 1) = S., I(t), u(t)] 


E E P 

St^<S SjGS 


Si jS'j 


(u)p[S(t) I /(()]p W + 1) I S(t + 1) = 


( 43 ) 
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where ^ (u) = + 1) = 5r | S{t) = Sj,u(t) = u] Now consider the term 

p[6{i + 1) = 9 \ S(t + 1) = Sj, I{t),u{t)] This can be written as 

p[0(f+l) = 0|5(t+l) = 5„J(t),u(i)] 

= Y^p [e{t + 1) = ^ I 5(t + 1) = 5„ S(f) = 5„ /(t), uit)] 
p[Sit) = S.\ Sit + 1) = S,Jit),uit)] 


=^Yp + 1) = ^ I + 1) = s„sit) = s^M-t)] 

s.^s 

p [Sit) = S, I Sit + 1) = J(0, uit)] (4 4) 

The last equation follows from that fact that the feedback output depends 
only upon S'(f), Sit + 1) and u(t) 

The probability p[0(t + 1) = 9 \ S(t + 1), 5'(f),u(f)] will assume values of either 
0 or 1 for particular values of Sit + 1), S(t) and u(f) 

Let us consider those values of Sit) = 5, such that 

p[9it + 1) = 0 I 5(t + 1) = Sj^Sit) = 5., uit)] = 1 (4 5) 

Thus Equation 4 4 can be written as 

p [9it + 1) = 9\ Sit + 1) = SjJit), uit)] = 

Y P [5(f) = 5, I Sit + 1) = /(t), uit)] (4 6) 

After some manipulations and applying Bayes' rule we get 


E p, , («)p[SW = s. I -rW] 
+ 1) = . I S(t4 1) = = ^gV' Mp[gW=T T / ( « )I 

s.es ^'<^3 


Substituting this relation m Equation 4 3 we obtain 


plS(i + l)= 5. I J((+l)l = 


E P, , MpISW = S, I 
E E „(«)p[SW = S. |/(t)l 

SjGSS.^Se 


(4 8) 
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This establishes the result □ 

Let Pit) = {/.[5(f) = 5 I /(i)],p[5(f) = 5, | 7(f)], ,/.[5(t) = 5^ | 7(f)]} 

Then Equation 4 8 can be written as function P of P(t), v(t) and 6{t + 1) 

Pit + 1) = P{P(f), n(f). Bit + 1)} (4 9) 

Thus P(f + 1) depends only upon P(f), the control action u(f) at time t and 
the observed feedback Bit + 1) 

We thus have an alternative representation of the finite user random access 
model where the state of the sytem is P(f) The control policy enables 
certain users and due to the transmission of packets by these enabled users, 
a feedback Bit + 1) is observed and the state of the system P(f) moves to the 
next stateP(f + 1) 

Remark 4.1.1 Note that the state P(f + 1) depends only upon the previous 
state P(f) and the control achon u(t) Thus for a given sequence of control 
actons, the sequence {P(f + l),t e 7} is a Markov Process 

4.2 The Optimal Collision Resolution Problem 

At the beginning of a collision resoluton epoch, some n users may be actve 
out of the total number of N users The number of actve users is, however, 
not known exactly, instead the initial probability vector P(0) is given The 
collision resoluton epoch ends when all users have resolved their collisions 

If we take P(f) as the state of our dynamical system, then the evolution of 
this state is completely governed by Equaton 4 8 Thus given P(f), u(f) and 
Bit + 1), P(f + 1) can be calculated exactly In other words, our model with 
P(f) as the state, will have perfect knowledge of the state at every stage Let 
r be the time instant at which users have resolved collisions, then at this stage 
we reach the state P(t) whose all components are zero except the probability 
p[5(t) = (0, 0) I 7(t)] which is equal to one The problem of optimally resolving 
the collisions is that of finding the control policy (if it exists) which minimizes 
the expected time to reach the state where p[5(t) = (0,0) | 7(r)] = 1 The 
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optimal collision resolution problem may thus be viewed as the optimal first 
passage problem of a dynamical system with P(t) as the state Similar to that 
of Chapter 3, the optimal collision resolution algorithm can be determined in 
principle In Chapter 3, we had finite state space and the optimal control 
policy can be specified by a look-up table where corresponding to each state 
we have the control action In this case, however, with P{t) as the state, we 
have an enlarged state space and the implementation of such an algorithm 
will be computationally burdensome 

We therefore do not go further into the discussion of the derivation of 
an optimal collision resolution algorithm Instead of attempting to determine 
an optimal algorithm by computationally feasible means, we suggest two 
suboptimal algorithms By comparing the performance of these two algorithms 
with bounds on the optimum performance, we conclude that these suboptimal 
collision resolution algorithms are quite satisfactory for practical purposes 

In the following section, we introduce these suboptimal algorithms The 
performance of these algorithms is discussed in the next section 

4.3 Suboptimal Collision Resolution Algorithm 

4.3.1 Suboptimal Collision Resolution Algorithm— 1 
(SOAl) 

The suboptimal algorithm suggested here is based upon updating the condi- 
tional probability vector P{t) at every stage with the help of observed feedback 
and the control applied The state S{t) is a two-dimensional vector [N{t), n(t)] 
and can assume any of the C values from the state space S = S 2 , , -S'/:} 

where S', = and N^ < N and n, < AT, The conditional probability 

vector gives the probability that the state S(t) can take each of these values 
at the instant t We know that if the initial state is given, then the state at 
every stage can be known exactly For such a perfect state information case, 
the optimal collision resolution algorithm is already known from Chapter 3 

In the suboptimal algorithm considered here (abbreviated as SOAl), the 
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users update the conditional probability vector and then choose the state 
which has the maximum value of probability Assuming this state to be the 
actual state, the corresponding control is then applied This control specifies 
the number of users to be enabled For this number, there will be many 
possible sets of users that can be enabled Specifically, if the number of 
unresolved users is Nt and the control action is u, then there will be total 
possible combinations The users choose one such set randomly by using a 
pseudorandom number generator with the same seed Thus all users generate 
the same set at its site The enabled users transmit their packets, if any, in 
the subsequent slot The feedback due to the transmission of these u users 
IS observed by all users The users then update the conditional probability 
vector This procedure is continued till all users have been resolved 

Steps of SOAl 

The steps of the algorithm can be summarized as 

• Choose the state Sk = {Nk, rik) which has the maximum value of proba- 
bility 

• Choose the control Uk correspondmg to Sk Uk would be the optimal 
value if Sk were the actual state 

• The algorithm enables Uk number of users in the slot + 1) 

• Observe the feedback 9(t + 1) 

• Update the conditional probability vector P(t + 1) by making use of the 
following equation 


E p, . iu)p[sit) = 5, 1 m 

S,sSe 

ZZp,, iu)p[S(t) = S, I !(()] 

Sj S.eSs 

^Sr = {Nr, Ur) G ^ 


p[S(f + 1) = S, I I{t + 1)] = 
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• If p[S{t + 1) = (0,0) I I(t + 1)] = 1, then stop Else repeat from the starting 
step 

4.3.2 Suboptimal Collision Resolution Algorithm— 2 
(SOA2) 

From optimal control theory, we know that in Linear Quadrate Gaussian 
(LQG) problem, the certainty equivalent principle holds good and certainty 
equivalent control is equivalent to the optmal control The second suboptimal 
algorithm considered in this section is motvated by this fact 

In the suboptimal algorithm considered here, we calculate the conditional 
probability vector and then compute the expected state The conditional 
probability vector gives the probability that the state S{t) can take each of the 
C values at the instant t Let the expected state at the instant the = (Ne,n^) 
Each of the components of the expected state can be calculated as 

N, = f;w.p[S(t) = 5. |/W1 (410) 

1=1 

ne = X;n,p[S(t) = 5J J(f)] (411) 

2=1 

We note here that Ne and Ue can take real values and the expected state S, 
therefore may not belong to the state space S In such cases, the nearest 
integer values of Ne and Ue are taken Denote this state by 5+ = (^+,71+) 
The optimal control corresponding to this state is then chosen assuming 
this to be the actual state Let this control be denoted by Ue 

This control specifies the number of users to be enabled For this number 
Ue, the users choose the particular set of users for transmission m a manner 
similar to that of SOAl The enabled users transmit their packets and the 
corresponding feedback is received by aU users The users then update the 
conditional probability vector and the whole procedure is repeated till all users 
are resolved, t e , we reach a stage where p[S{t) = (0, 0) | /(f)] = 1 

Steps of SOA2 

The steps of the algorithm SOA2 can be summarized as 
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• Calculate the probability vector P{t) = {p[S{t) = Si | I(t)],p[S(t) = S 2 | 

mi ,p[s(t) = Sc\m]} 

• Compute the expected state = (Ne.nc) where p[S{t) = 

(Ar„nO I /(i)] and n, = = (iV^n.) | /(*)] 

• Compute the state = (N^,n'^) where X'* denotes the nearest integer 
of X 

• Choose the ophmal control corresponding to 

• Enable u^. number of users m the slot (t, f + 1) 

• Observe the feedback 9{t + 1) 

• Update the conditional probability vector P{t + 1) by making use of 
Equation 4 8 

• If p[S(t + 1) = (0,0) I I(t +!)] = ! then stop Else repeat from the 
beginning 

4.4 Simulation of Suboptimal Collision Resolu- 
tion Algorithms 

In the previous section, we have introduced the two suboptimal algorithms 
In this section, we discuss the performance of these algorithms For illustration 
purposes, we perform the simulations for various initial probability distribution 
of the states for a total population of AT = 8 users Since all users are unresolved 
at the begmnmg of a collision resolution epoch, initial probabilities of the states 
like where 7 ^ 8 are zero The remammg probabilities are chosen 

arbitrarily 

Alternatively, if we know the probability cr with which a user generates 
a packet then since the user has only one buffer to store any new packet, it 
can have at-most one packet at the beginning of any epoch Let p be the 
probability that a user has a packet at the beginning of the epoch, when the 
length of the previous epoch is then 
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p = l-(l-aY 


In such cases, we may enable all users mitally If no user is active, then 
the users receive an empty feedback and the collision resolution epoch ends 
If only one user is active, a success feedback is received and all users are 
resolved If, however, a collision feedback is received then it is known that 
more than one user is active Let p(n) denote the probability that n users are 
active given that at-least two users are active, then p(n) is given by. 


p{n) = 


1 - (1 - p)« - Np(i - p)"-! 


for n> 2 


The initial probabilities of the states of type (AT, n) where iV = 8 and n 
varies from 2 to 8 can be calculated by the following relation. 


p 1S(0) = (W,n)] = Pin) 

Our suboptimal algorithm can then be employed to resolve the collision 


4.4.1 Procedure for Simulation 

In all the examples discussed below, we perform the simulation experiment 
by taking each possible state (i e, the state which has probabihty greater than 
zero) as the initial state and obtain the average collision resolution length for 
each case 

For each possible state, there will be several possible ways in which active 
users can be distributed amongst all users If the state is (AT, n), then this 
distribution of n active users amongst total N users can be represented by an 
AT-dimensional binary vector In this vector, there will be n ones and (N — n) 
zeroes The one m the fcth position of this vector indicates that the user with 
the address k has a packet while zero indicates that the user does not have a 
packet We call a particular realization of the users in this manner as an Active 
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Table 4 1 Active User Patterns 


Address of 
User 

Active User 
Pattern 

1 

1 

1 

1 

0 

0 

2 

0 

0 

0 

0 

1 

3 

0 

0 

0 

0 

0 

4 

1 

0 

0 

1 

0 

5 

0 

1 

0 

0 

0 

6 

0 

0 

0 

0 

1 

7 

0 

0 

0 

1 

0 

8 

0 

0 

1 

0 

0 


User Pattern For example, for the state (8,2), there will be = 28 possible 
active user patterns Some of them are shown in Table 4 1 

In the first pattern of this example, we note that the users 1 and 4 have 
packets while rest other users do not have any packet Similarly, we can 
explain for the other patterns The simulation expenment is performed for 
each possible active user pattern and the average colbsion resolution length 
for a given initial state is obtained by taking averages over all simulation runs 
and all active user patterns of that state 

Note that the suboptimal algorithms SOAl and SOA2 specify only the 
number of users to be enabled as the control action For this control action, 
there will be many possible control vectors Similar to a user pattern, a control 
vector IS a bmary vector with Is and Os The one m a particular position of 
this vector indicates that the corresponding user is enabled for transmission 
Clearly, the number of such ones is equal to the number of users to be 
enabled The specific control vector is chosen randomly from amongst all 
possible vectors For this, all users use a pseudorandom number generator 
usmg the same seed with the result that all users select the same vector The 
enabled users transmit their packets if any 

For the same active user pattern, there can be several possible realizations 
of simulation experiments depending upon different control vectors used at 
each stage of the experiment Sufficient number of simulations are performed 
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for each user pattern and the collision resolution lengths are averaged over 
all such simulation runs The final expected collision resolution length is 
calculated by averaging the length over all user patterns The number of runs 
are considered sufficient, if this expected collision resolution length remains 
unchanged to approximately three decimal places even if more number of 
runs are used 

In the followmg examples, the probability distributions are chosen to rep- 
resent a range of user loading from light to heavy, but otherwise these 
probabilities are arbitrarily selected Let L\ and X 2 denote the expected col- 
lision resolution lengths for SOAl and SOA2 respectively Let Lbc denote a 
bound (calculated as shown below) on the optimal expected colhsion resolution 
length 

Example 4.4.1 The initial probabilities of the states for this example are given 
in Table 4.2 The probabilities of the remaining states are zero 

Table 4 2 Initial Probability Distribution-1 


State 

Probability 

(8,1) 

0 90 

(8,2) 

0 05 

(8,3) 

0 05 

(8,4) 

0 00 

(8,5) 

0 00 

(8,6) 

0 00 

(8,7) 

0 00 

(8,8) 

0 00 


As explained earlier, the simulations were performed for every user pattern 
of each possible initial state, i e , of the states having nonzero probability, for 
the two subophmal collision resolution algorithms- SOAl and SOA2 k Total 
3000 runs were found sufficient for each user pattern for the expected collision 
resolution length to converge to at-least three decimal places The average 
collision resolution lengths for the three possible states, te , (8,1)/ (8,2), (8,3) 
obtained after averaging over 3000 runs and over all possible patterns are 
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tabulated in Table 4 3 for both the suboptimal algorithms 


Table 4 3 Simulation Results for Probability Distribution-1 


State 

Average Collision 
Resolution Length 


SOAl 

SOA2 

(8,1) 

1 00000 

1 00000 

(8,2) 

3 94527 

447428 

(8,3) 

5 92335 

5 64090 


The states (8, 1), (8, 2) and (8, 3) occur with probabilities 0 9, 0 05 and 
0 05 respectively, hence the expected collision resolution lengths due to the 
suboptimal algorithms are given by. 

For SOAl U = 1 393 
For SOAl L 2 = 1 405 


Bound on the Optimal Performance The optimal collision resolution algorithm 
IS known when the initial state is given The optimal collision resolution 
lengths for each initial states are given in Table 4 4 The expected collision 

Table 4 4 Expected Colhsion Resolution Length with Known Initial State 


Initial State 

Expected Collision 
Resolution Length 

(8,1) 

1000 

(8,2) 

2571 

(8,3) 

4189 

(8,4) 

5471 

(8,5) 

6 888 

(8,6) 

7 357 

(8,7) 

7 750 

(8,8) 

8 000 


resolution length due to this algorithm when the mitial state has the given 
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probability distribution of Table 4 2 can be shown to be equal to 1 238 This 
value would serve as a bound on the expected collision resolution length that 
would have been obtained if the optimal algorithm were known by following 
the formulation of Section 4 2 

We thus see here that the algorithm SOAl performs marginally better than 
the algorithm SOA2 Both the algorithms perform worse than the ophmal 
algorithm While the expected collision resolution lengths due to the two 
suboptimal algorithms SOAl and SOA2 are 1 393 and 1 405 respectively, the 
bound on the optimal expected collision resolution length is 1 238 Thus the 
degradation in performance for the two suboptimal algorithms is only about 
12 5% and 13 4% respectively for this example 

Example 4.4.2 The initial probabilities of the states for this example are chosen 
as indicated in Table 4 5 

Table 4 5 Initial State Probabilities-2 


State 

Probability 

(8,1) 

0 70 

(8,2) 

020 

(8,3) 

0 05 

(8,4) 

0 05 

(8,5) 

0 00 

(8,6) 

0 00 

(8,7) 

0 00 

(8,8) 

0 00 


As m Example 4 41, the probabihhes of other states are zero In this 
case also, the simulations were performed for different runs for both the 
algorithms The results obtained after 4000 simulation runs, which were 
considered adequate, are tabulated in Table 4 6 

The expected collision resolution lengths due to the two suboptimal algo- 
rithms are given by 

For SOAl Li = 2195 
For SOA2 U = 2 260 
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Table 4 6 Simulation Results for Probability Distribution-2 


State 

Average Collision 
Resolution Length 


SOAl 

SOA2 

(8,1) 

1 00000 

1 00000 

(8,2) 

3 72372 

446107 

(8,3) 

6 70293 

6 00374 

(8,4) 

8 32059 

7 35400 


Bound on the Optimal Performance For the probability distribution of this 
example, is equal to 1 697 

From these results, we again observe that SOAl performs better than SOA2 
While the bound on the optimal expected collision resolution length is 1 697, 
the expected collision resolution lengths due to the suboptimal algorithms SOAl 
and SOA2 are 2 195 and 2 260 respectively The performance degradation with 
respect to the bound is about 29 3% and 33% for the two algorithms 

Example 4.4.3 For this example, we take the probability distribution as given 
in Table 4 7 


Table 4.7 Initial State Probabibties-3 


State 

Probability 

(8,1) 

010 

(8,2) 

015 

(8,3) 

0 25 

(8,4) 

0 50 

(8,5) 

0 00 

(8,6) 

0 00 

(8,7) 

0 00 

(8,8) 

0 00 


For this probability distribution, 7000 simulations runs for the algorithm 
SOAl and 6000 runs for SOA2 were found sufficient The simulation results 
are given in Table 4 8 
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Table 4 8 Simulation Results for Probability Distribution-3 


State 

Average Collision 

Resoluhon Length 

SOAl 

after 7000 runs 

SOA2 

after 6000 runs 

(8,1) 

3 50223 

4 00000 

(8,2) 

4 71542 

4 38934 

(8,3) 

5 53372 

515610 

(8,4) 

5 75912 

5 87807 


The expected collision resolution lengths due to the two suboptimal algo- 
rithms are given by 

For SOA7 = 5 320 

For SOA2 Lz = 5 286 

The bound on the optimal expected collision resolution length in this case can 
be calculated to be equal to 4 268 

We see that in this case the suboptimal algonthm SOA2 performs better 
than SOAl The performance degradation due to SOAl and SOA2 is about 
24 6% and 23 8% respectively 

Example 4.4.4 The initial probability distribution for this case is given in 
Table 4 9 This probability distribution can be considered as representative of 
heavy user loading 

In this case, the simulations were performed for 5000 runs The average 
collision resolution lengths are tabulated m Table 4 10 

From these results we have 

For SOAl Li = 8 029 
For SOA2 L 2 = 8 000 


The bound on the optimal expected collision resolution length is readily seen 
to be equal to 7 887 
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Table 4 9 Initial State Probabilities-4 


State 

Probability 

(8,1) 

0 00 

(8,2) 

0 00 

(8,3) 

0 00 

(8,4) 

0 00 

(8,5) 

0 05 

(8,6) 

0 05 

(8,7) 

010 

(8,8) 

0 80 


Table 4 10 Simulation Results for Probability Distribution^ 


State 

Average Collision 
Resoluhon Length 

SOAl 

SOA2 

(8,5) 

7 78479 

80 

(8,6) 

8 32013 

80 

( 8 , 7 ) 

8 24602 

80 

(8,8) 

8 00000 

80 


For this example, SOA2 performs marginally better than SOAl Note that 
both the suboptimal algorithms give performances which are close to the 
bound 

Example 4.4.5 In this example, the initial probability distribution is given in 
Table 4 11 

The average colllision resolution lengths for this probability distribution 
after 4000 simulation runs are tabulated in Table 4 12 

The expected collision resolution lengths can be calculated as 

For SOAl Ii = 7 780 

For SOA2 Lj = 6 766 

For this probability distribution Lbo — 5 403 
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Table 411 Initial State Probabilities-5 


State 

Probability 

(8,1) 

0125 

(8,2) 

0125 

(8,3) 

0125 

(8,4) 

0125 

(8,5) 

0 125 

(8,6) 

0125 

(8,7) 

0125 

(8,8) 

0125 


Table 4 12 Simualtion Results for Probability Distribution-5 


State 

Average Collision 
Resoluton Length 


SOAl 

SOA2 

(8,1) 

1 00000 

3 24937 

(8,2) 

4 07229 

4 08930 

(8,3) 

6 80261 

5 42930 

(8,4) 

8 64269 

6 85850 

(8,5) 

9 72966 

7 97670 

(8,6) 

10 25106 

8 59441 

(8,7) 

10 74631 

8 93931 

(8,8) 

11 00000 

9 00000 


In this example also, the suboptimal algonthm SOA2 is seen to perform 
better than SOAl. The degradation in performance with respect to the bound 
Lbo for SOAl and SOA2 is about 43% and 25 2% respechvely 

Remark 4.4.1 We note that in Example 4 41 and Example 4.4 2, the subopti- 
mal algorithm SOAl which chooses control actions based on the state having 
maximum value of probability performs better than the algorithm SOA2 which 
chooses control actions based on the expected state The mitial probability 
distributions of these examples represent the cases when the users are lightly 
loaded When the users are moderately and heavily loaded, as in other 
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examples, the algorithm SOA2 is seen to perform better 

Remark 4.4.2 The degradation in performance for the two suboptimal algo- 
rithms with respect to a bound is not significant for the examples considered 
Since the optmal algorithm for the case when the initial state is known only 
probabilistically, will perform worse than this bound, it is reasonable to assert 
that these suboptimal algorithms are quite satisfactory 

In the above examples, the initial probability distributions of the states 
were chosen to represent a range of user loading but otherwise arbitrary 
If the packet arrival process to each user is a Bernoulli process with arrival 
probability a, then as mentioned earlier, we may enable all users initially If 
no user or only one user is active, then the collision resolution epoch ends 
However, if collision occurs, then it is known that more than one user is active 
Given the packet arrival probability a and the fact that more than one user 
IS active, we can then calculate the initial probability distribution and employ 
the collision resolution algorithms The following two examples approximate 
the cases when the packet arrival probability <7 is 0 1 and 0 3 respectively and 
where it is known that more than one user is active 

Example 4.4.6 The probability distribution is given in Table 4 13 The simu- 

Table 4 13 Initial State Probabilities-6 


State 

Probability 

(8,1) 

0 000 

(8,2) 

0 796 

(8,3) 

0176 

(8,4) 

0 028 

(8,5) 

0 000 

(8,6) 

0 000 

(8,7) 

0 000 

(8,8) 

0 000 


lation results after 7000 runs are given in Table 4 14 
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Table 4 14 Simulation Results for Probability Distribution-6 


State 

Average Collision 
Resolution Length 


SOAl 

SOA2 

(8,2) 

2 68055 

2 69557 

(8,3) 

5 33706 

5 29235 

(8,4) 

8 09977 

8 02116 


The expected collision resolution lengths are 

For SOA! U = 2 299 

For SOAl L 2 = 3 301 

For this probability distribution Lopt = 2 936 

Example 4.4.7 The probability distribution for this example is given m Table 
4.15 


Table 4 15 Initial State Probabilities-7 


State 

Probability 

(8,1) 

0 000 

(8,2) 

0 398 

(8,3) 

0 341 

(8,4) 

0182 

(8,5) 

0 062 

(8,6) 

0 017 

(8,7) 

0 000 

(8,8) 

0 000 


The simulations were performed for 4000 runs and the average collision 
lengths obtained after averaging over all these runs for each possible initial 
state are given in Table 4 16 

The expected collision resolution lengths can be easily calculated as follows 


For SOAl Li 


4 972 
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Table 4 16 Simulation Results for Probability Distribution-7 


State 

Average Collision 
Resolution Length 


SOAl 

SOA2 

(8,2) 

2 89908 

3 78721 

(8,3) 

5 11228 

4 70663 

(8,4) 

7 25946 

6 45033 

(8,5) 

9 19268 

8 20135 

(8,6) 

10 86720 

10 06566 


for SOAl L 2 = 4 965 
For this probability distribution Lopt = 3 999 

4.5 Performance of Suboptimal Algorithms in 
the presence of Feedback Error 

In the previous sections, we have assumed that the feedback channel is 
noiseless and the users know the status of the slot correctly, i e , whether the 
slot IS empty or it contains one packet or more than one packet In a reabstic 
situation, the users may observe the feedback incorrectly due to the presence 
of channel noise Apart from the fact that the initial state is known only 
probabilistically, the feedback error introduces further uncertainty about the 
state of the system In this section, we see how the feedback error affects the 
performance of our colhsion resoluhon algorithms The model considered for 
this study was introduced by Massey [44] We first describe this model and 
then study the performance of the algorithms under this channel model 

Massey’s Feedback Channel Model 

The channel model introduced by Massey for feedback error analysis is the 
discrete memoryless channel as shown in Figure 4 2 The channel mput is the 
actual status of the slot and the channel output is the feedback received by 
users The model assumes that if a slot contains more than one packet, then it 
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Figure 4 2 Massey's Model for Feedback Channel 

would be correctly perceived by the users as the collision with probability one 
If the slot IS empty, then with probability (p, it could be mterpreted by the 
users as the collision slot An empty slot, however, will never be interpreted 
as the successful slot The motivation behind assuming this is that in practice 
each packet would be encoded with some kind of error correctmg code so 
that the probability that the receiver would identify an empty or a collision 
slot as a success would be very low 

Similarly m this model, a slot with successful transmission can be mistaken 
as a collision slot with probabihty e It is realistic to assume that the only 
types of errors that can occur on the channel are those which result in the 
receiver mterpretmg the feedback as collision when the actual status of the 
slot in fact had been either empty or success 

Let denote the actual feedback received by the users when the true 
feedback is 9 Let 0, 1 and 2 represent empty, success and collision respectively 
Then our model can be represented by the following relations 

= 2 I 0 = 1] = €, pie, = 1 I 0 = 1] = 1 - e, p[0, = 0 I ^ = 1] = 0 

p[0^ = 2 I 0 = 0] = VP, p[e, = 1 I 0 = 0] = 0, p[9, = 0\9 = 0] = l-ip 

p [0^ = 2 I 0 = 2] = 1, p[9, = l\ 9 = 2] = 0, p[9, = Q\9 = 2]=0 

With this channel model to represent feedback errors, we perform the simu- 
lations of our subophmal collision resolution algorithms in the next section 
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».l Simulation of Suboptimal Algorithms in the presence 
of Feedback Error 

illustration purposes, similar to Section 4 4, we take the number of users 
to be equal to 8 The simulation procedure adopted is also similar to that 
the previous section We perform the experiment for two initial probability 
stributions For each possible initial state, there will be several ways m which 
tive users are distributed among the total population The similar experiment 
performed for sufficient number of runs for every possible realization of 
le state and the average collision resolution length is obtained by averaging 
ver all realizations and the simulation runs Here, however, the users receive 
le corrupted feedback information In this experiment, the actual feedback 
btamed due to this control action is passed through Massey's channel before 
leing received by the users The two examples to illustrate the effects of these 
-hannel errors are discussed below 

Example 4,5.1 The initial probabilities for this example are chosen to be the 
same as that of Example 4 41 and given m Table 4 2 We have seen that the 
algorithm SOAl performs better m this case. We choose this algorithm to 
study the effects of channel errors for this and the next example The average 
collision resolution lengths obtained for each initial state after 4000 simulation 
runs are given Table 4 17 for various values of error probabilities e and The 

Table 4.17 Results for Probability Distnbuhon-l Feedback Error 


State 

e = 001 

ip = 0.01 

e = 010 

if = 0 01 

€ = 0.01 
<p = 010 

e = 050 

V? = 0 01 

e = 001 
yp = 0 50 

(8,1) 

(8,2) 

(8,3) 

1.02806 

4 00031 

5 96319 

1 29565 

4 41959 

6 18345 

1 03025 

4 06241 

5 96439 

3 08912 

6 52030 

7 76496 

104990 

4 38991 

5 98151 


1423 

1695 

1428 

3494 

1462 


expected colhsion resolution length L-^ for this probability distribution is also 
shown in the table 




CHAPTER 4 SUBOPTIMAL ALGORITHMS 


105 


We see from this table that if (^ = 0 01 and e is varied as 0 01, 0 1 and 

0 5, the expected collision resolution length L] varies as 1 423, 1 695 and 3 494 
However, if f = 0 01 and ip is varied as 0 01, 01 and 0 5, then L\ varies as 

1 423, 1 428 and 1 462 respectively We thus note that the effect of p is less 
pronounced than that of e on the performance of the algorithm 

Example 4.5.2 The initial probability distribution for this example is the same 
as that of Example 4 4 2 (given in Table 4 5) The average collision resolution 
lengths for each state after sufficient simulation runs are given in Table 4 18 
for various values of e and p The total expected collision resolution length is 
also calculated and shown in the table 


Table 4 18' Results for Probability Distribution-2 Feedback Error 


State 

il li 

O O 
O O 

€ = 010 
= 0 01 

e = 001 

if = 010 

e = 050 

V? = 0 01 

e = 001 
= 0 50 

(8,1) 

1 02790 

128712 

1 03012 

2 90653 

104490 

(8,2) 

3 76901 

4 18202 

3 81395 

6 51599 

4 11222 

(8,3) 

6 75601 

7 14088 

6.79681 

8 90598 

7 00136 

(8,4) 

8.34453 

8 55260 

8.34065 

10 25330 

8 33762 

Lx 

2 227 

2 251 

2 240 

4 295 

2 320 


Similar to the above example, we see that as e is varied as 0 01, 01 and 
0 5 keeping p fixed at 0 01, the expected collision resolution length Li varies 
as 2 227, 2 521 and 4 295 However, if e is fixed at 0 01 and p varies as 0 01, 
0.1 and 0 5, the value of L\ varies 2 227, 2 240 and 2 320 

The important conclusion of these results is that the probability e which 
IS the probabihty that a successful slot will be interpreted as a collision slot 
has marked effect on the performance while the probability p which is the 
probability that an empty slot will be mterpreted as a collision slot does not 
have significant effect 




Chapter 5 

A Blocked Random Access 
Algorithm for Buffered Users 


In the previous chapters, we have considered users each with a single packet 
In any practical network, a user will have a buffer with a storage capacity of 
more than one packet In this chapter, we consider the case of buffered users 
For analytical simplicity, we assume that the buffer size is infinite, although in 
practice a user can have only finite storage capacity For such buffered users, 
we adopt and analyze an access protocol 

We begin this chapter by looking at the nature of the queueing problem for 
buffered users when a simple random access algorithm like ALOHA is used 
We then discuss the system model and the mechanism of our protocol The 
operation of the system can be divided into successive transmission intervals 
called transmission epochs We show that the sequence of the transmission 
epoch lengths is a Markov chain The expressions for evaluating the transition 
probabilities of this Markov chain are then derived The ergodicity of this 
chain implies the stability of the system Sufficient condihon for the ergodicity 
IS stated and proved We suggest an iterative and truncahon procedure to 
calculate the steady state probabilities of the transmission epoch length By 
obtaming the steady state probabilities, the expected transmission epoch length 
under dynamic operating condition can be calculated The average packet 
delay analysis is then performed It is shown that the packet delay consists 
of three components Expressions for each of these components are derived 
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i their significance is explained The expected transmission epoch lengths 
d packet delays are then compared with the corresponding quantities for a 
lling type of protocol suggested and analyzed here This protocol is in fact 
/ariant of TDMA for buffered users 

.1 Queueing Problem for Buffered Users 

Ihen a random multiple access protocol is used for a finite population of 
offered users, an interesting problem of interacting and coupled queues arise 
he analysis of the steady state behavior of the system is in general difficult 
0 evaluate Even if a simple random access algorithm like ALOHA is used 
or buffered users, the behavior of the system is known only for some simple 
'ases 

In general, the behavior of these systems can be modelled by an N- 
dimensional Markov Chain with the state defined as Q = {Qi,Q 2 , ,Qn) 
where Q, is the number of packets in the queue of rth user and N is the 
total number of users in the system The problem here is concerned with the 
enormous size of the state space Szpankowski [71] has studied the ergodicity 
of such an iV-dimensional Markov chain and has obtained upper and lower 
bounds for the stable region of the system In [68], a system consisting 
of only two interfering queues is considered and exact analytical results are 
derived For systems with queues greater than two, they have suggested an 
approximate method Several other approximate models to study the behavior 
of general interactmg queues have been considered [36, 70] In [66], Saadawi 
and Ephremides have used two Markov chains, one describes the state of 
the system and the other, the state of a user The average packet delay and 
throughput can then be calculated by solving a set of simultaneous coupled 
nonlinear equations Another approximate model that reduces the size of the 
state space has been proposed in [70] 

In the protocol considered in this chapter, we use the optimal collision 
resolution algorithm of Chapter 3 But only the first packet of the buffer 
participates in the collision resolution process The remaining packets present 
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1 the buffer at the beginning of the epoch follow a Come Right-m type 
f collision free strategy The analysis of the protocol is then considerably 
imphfied as compared to ALOHA for buffered users 

5.2 System Model 

\s mentioned in Chapter 3, we consider a finite population of N users 
However, each user mstead of having storage capacity of just one packet, is 
provided with a buffer of infinite size All other assumptions regarding the 
system are the same as those of Chapter 3 The channel time, as before, 
IS slotted At the end of each slot, all users receive ternary feedback The 
feedback is assumed to be errorless 

The packet generation process at each user is assumed to be a discrete 
time Bernoulli process Lei a be the probability with which a user generates 
a packet in a slot A user can generate at most one packet in each slot We 
assume for convenience that a packet is generated at the begmning of a slot 
The packets are stored m the buffer till they are transmitted successfully We 
discuss below the mechanism of this access protocol The first packet in the 
buffer of a user is referred as the head of the line (HOL) in the sequel 

5.2.1 Mechanism of Access Protocol 

We consider the dynamic operation of the system This dynamic operation of 
th^ system can be divided into successive transmission epochs as shown in 
Figure 5 1 Only those packets which have been generated in the previous 
epoch are transmitted m the current transmission epoch The remaining 
packets, as and when they arrive, are queued in the buffer Thus the access 
protocol IS of the blocked access type 

Definition 5.1 We say that a -packet in the buffer of any active user is an old packet 
if it was generated in the previous epoch 

Thus all users which are active at the beginning of an epoch transmit their 
old packets in the current epoch The access protocol consists of the collision 
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Figure 5 1 Dynamic Operation of the Protocol 
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Figure 5 2 Transmission Epoch 
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esolution algorithm of Chapter 3 which is used by the HOL packet and a 
olhsion free strategy used by the other old packets of the buffer 

At the beginning of a transmission epoch, the number of active users 
s known to each user The mechanism of knowing this has already been 
explained in Section 3 1 The HOL of each user participates in the collision 
resolution process using the collision resolution algorithm As soon as any of 
these packets is transmitted successfully, the collision resolution algorithm is 
interrupted and all other old packets of the successful user are transmitted 
in consecutive slots An empty slot at the end indicates the end of the 
transmission of these packets After this, the collision resolution algorithm 
starts agam from the point where it was mterrupted This procedure continues 
till the active users have transmitted all their old packets 

Each transmission epoch as shown in Figure 5 2 can be seen to consist ot 
several sections If the number of active users at the beginning of an epoch is 
n, then there will be total n-sections in the epoch, each section corresponding 
to an active user Let 4+i be the length of (i + l)th epoch Each section 
has two subsections- one Collision Resolution Subsection and another Successful 
Racket Transmission Subsection The collision resolution subsection ends with 
the successful transmission of HOL of an active user 

Let and denote the lengths of the collision resolution subsection and 
the successful packet transmission subsection of ^th section of (^ + l)th epoch 
The collision resolution part of an epoch is the sum of the collision resolution 
subsections of the epoch Similarly the successful packet transmission part of 
an epoch is equal to the sum of the successful packet transmission subsections 
Let the lengths of these parts be denoted by and respectively We 
then have 

A+i = 4+1 + 4+1 


4+1 = 4Vi+4+i+ +C+1 

4+1 = 4li+4ii+ +4+1 


and 
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. 2.2 The System Markov Chain 

.’onsider the sequence of transmission epoch lengths = 0,1, } The 

?ngth of any transmission epoch (say of (^ + l)th epoch) is a random 
ariable and depends upon the number of packets transmitted in it Due to 
he nature of the protocol considered here, the number of packets transmitted 
n an epoch depend only upon the length of the previous epoch This fact 
■an be expressed as 


Pro6[4+] = A: I f’, = ,-fo] = Pro6[£,+] = Ar | £, = ^] 

n other words, we have the following lemma 

Lemma 5.1 The sequence of transmission epoch lengths {4, z = 0, 1, .} is a Markov 

:ham with state space Z = {1,2, } 

We will discuss the ergodicity of this Markov chain later But first, we turn 
our attention to the evaluation of the probabilities of state transitions 

5.3 Evaluation of the State Transition Probabili- 
ties 

Let TTj^k denote the probability of transition from the state j to the state k ot 
the Markov chain {4,* =0,1, }, te, TTj^k = Profe[4+i = A? | 4 = j] These 

state transition probabilities can be evaluated as follows 

Let T)i denote the number of active users at the beginning of zth transmission 
epoch, then can be written as 

■Kj^k = Pro6[4+i = A: I 4 = j] 

N 

= Y, ■P’"ot)[4+i = At 1 4 = Prob['r),+^ = ri\£, = j] (51) 

n=0 

where Proh[ 7 ],+i = n \ £, = j] = pin \ j) denotes the probability that the number 
of active users at the beginning of a transmission epoch is n given that the 
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length of the previous epoch was j If p is the probability that a user is active 
at the beginning of an epoch, then p{n \ j) is given by 

P(n|3)= (5 2) 

Since each user generates a packet with probability <j in a slot and if the length 
of the previous epoch is j, we have 

p = l-(l - ay (5 3) 


We then have from Equation 5 1 

Ttj^k = Prob[£,+i = k \ I, = = 0]p(0 | j) 

N 

+ ^ Prob[£,^-i = k\e^ = j, = n]p{7i \ j) (5 4) 

n=l 


If no user is active at the beginnmg of an epoch, then the epoch will consist 
of one empty slot only Hence 


Prob[£,+i = k\£^ = J, p,+i 


f 1, for fc = 1 
\ 0, otherwise 


(5 5) 


can therefore be written as 

N 

= ^o,fc-ip(0 h) + S -P^o^lA+i =k\£, = ;,77,+i = n]p(n \ j) (5 6) 

n=l 


where 



for J = k 
otherwise 


Since 4+1 = 4+1 + 4+1 where the collision resolution part and the 
successful packet transmission part 4%! are independent random variables, 
Prob[£^+l = k \ £^ = J, ??,+] = n] is the convolution of the probabilities of 4+i 
and 4+1 Hence we have 


N rij 

T^],k = 2io,jt-ip(0 1 :/) + ^ P'f'ob\£l+-[ = M I 4 = 

n=l k\—Q 

Fr-o6[4+i = A: - fci I 4 = = n]p(n | j) 

N nj 

= Aok-}P(0 I j) + E E - ki)p{n I j) (5 7) 

71 = 1 ki=0 
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In this equation 7rJ„(^]) = = ^i I 4 = Ji’li+'i — ’^] is the probability 

distribution of the successful packet transmission part of the epoch Similarly 
7r[^(A — k]) = Prof>[/J ^3 = k — k] | /, = = n] is the probability distribution 

of the collision resolution part of the transmission epoch and is independent 
of the previous epoch length We will determine 7rJ„(A:i) and 7rf,(A- - A]) 


5.3.1 Determination of 7rj „(A:i) 


Define Cnj(ky) as follows 
If ^ = 1 then 


if A] = n 
otherwise 


(5 8) 


If j > 1 then 



The above summation is over the set K = {(^' 1,^2 
We then have the following theorem 



(5 9) 


X) 


= A:i,VA; >1} 


Theorem 5.1 The probability distribution of the successful packet transmission part 
of the epoch 7r®^(Ai) is given by 


TT, 




a*i(l-(rp"-*i ^ (IS 


. 0 , 


for n <k\ <nj 
otherwise 


(5.10) 


where C„j(Ai) is as defined above 


Proof We consider three different cases 


1 For n > 1 and j = 1 

In this case the statement of the theorem reduces to the following 



for Ai = n 
otherwise 


(511) 


Since the length of the previous epoch is one slot only, at most one 
packet could have arrived to each user If the number of active users 
is n, each of them would contribute one slot to the successful packet 
transmission part of the epoch and thus the length of this part can only 
be rt This proves the statement 
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2 For n = 1 and j > 1 

If r 7 = 1 and j > 1 then 7 r’„(A]), according to the theorem, is given by 






for 1 < < J 

otherwise 


(512) 


If only one user is active, then the length of the successful packet 
transmission part is equal to the number of old packets m the buffer 
other than the HOL packet plus one slot accounting for an empty one 
mdicating the termination of packets' transmissions This is equal to the 
number of old packets in the buffer given that the user contains at-least 
one packet Since a user generates a packet with probability a, we have 


Prof) [Number of old packets in the buffer of the active user = A-j] 


1 - (1 - cry 


for 1 < A)] < J 

(513) 


7 r®„(A:i) for n = 1 and ^ > 1 is then given by 


TT 




(fci) 


0 , 


for 1 < Aji < J 
otherwise 


(514) 


3 For n > 1 and j > 1 

Let ai, a 2 , , Un be the addresses of n active users for a specific realization 

of active user pattern Let be the number of packets in the buffer of 
the user Or at the beginning of (i + l)th epoch Then 


Prob [ 6^1 = K\ii = j] 


1 - (1 - ay 


= m) 


(5 15) 


Let denote the length of the successful packet transmission subsection 
due to the user o, m (z + l)th transmission epoch Cy is the sum of 
subsections, t e , 



CHAPTER 5 BUFFERED USERS 


115 


7 rJ„(A-]) can therefore be written as 

n] = 

= K I A = = '^] 

(516) 


= A-, I /, = = 


The above summation is over all possible values of , k'^ such that 

their sum is equal to A:] and each of them is greater than or equal to one 

But by definition ~ - 1 + 1 = 6 ^X 1 One is subtracted here because 

the HOL packet is already counted in the collision resolution subsection 
and the second one is added to count for the last empty slot Since each 
IS an independent random variable we have for n<k\<nj 

K 

= Y.dKm'i) ((k'n) (517) 

k 


Substituting for each of ^(A;() from Equation 5 15 into this equation we 
have 


TT. 




- ay>^ f j\ 

{1 - (1 - Y Ui/ 1 ^ 2 / V^nj 

a {1-ay n<ki<nj (5 18) 

{I - (1 -ay}^ 


This establishes the theorem 

The following lemma of combinatorics enables us to compute the value of 
Cn,j{k\) in a convenient way 


Lemma 5.2 Let K = {{k\,k'^ X) TUK = h, VA; > 1} then 



/(n - r)j\ 

[ k, ) 


(519) 


Proof The proof is straightforward and omitted here 


□ 
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5.3.2 Determination of 7r^(fc2) 

IS the probability distribution of the collision resolution part of the epoch, 
when the number of active users at the beginning of the epoch is n Within 
an epoch, the collision resolution algorithm employed by the HOL packet is 
the optimal collision resolution algorithm of Chapter 3 

Let us consider only the collision resolution part of the epoch ignoring 
the successful packet transmission part of the epoch If n is the number of 
active users at the beginning of the epoch, then the initial system state for 
the collision resolution algorithm is (N,n) Let denote the state 

transition probability from (N,n) to (0,0) when the optimal control policy is 
employed Let denote the corresponding k 2 -step state transition 

probability, t e , 

(0,0) = (O' 0) I 5(0) = (N, n). ^'1 (5 20) 

Here S{0) is the initial state and S{k 2 ) is the state at the A: 2 th mstant 

By definition, ' 7 r^(fc 2 ) is the probability that the system reaches, for the first 
time, the state (0, 0) from the mitial state (AT, n) in ^2 slots, t e , 


<{h) = 

Prob [S{k 2 ) = (0, 0), Sik 2 - 1) ^ (0, 0), , S(l) 7 ^ (0, 0) I S(0) = {N, n), 

(5 21) 


Clearly for A :2 = 1 we have 


7r^(l) = p 


(5 22) 


Since the state (0, 0) is the absorbing state of the Markov chain characterizing 
the collision resolution algorithm, we have for ^2 > 1 


P 


(^ 2 ) 

(N,n),(0,0) 






r=l 


(fci-O 

( 0 . 0 ), ( 0 , 0 ) 






(5 23) 
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Similarly we have 


p;.: 

T--] 


1 ) 

(/V,n),(0,0) ' 


Subtracting Equation 5 24 from Equation 5 23 we obtain 


(5 24) 


■' (N,n),{0,0)'' ’ ^Wn),(0,0)'- ’ 




(5 25) 


We have thus proved the following lemma 


Lemma 5.3 The probability distribution of the collision resolution length, <(A- 2 ), is 
given by 


<(A2) 




(5 26) 


By substituting the values of 7r^(k-k]) and T^fjkf) from Equations 5 26 and 
5 10 in Equation 5 7, the state transition probabibties ^ can be evaluated The 
state transition probability matrix JJ = [Tr^^jt] can thus be constructed Since 
the state space of the Markov chain {£^,^ = 0,1, } is infinite, this probability 

matrix U is also of infinite order This Markov chain {4,r = 0,1, } satisfies 

the following property 


Proposition 5.1 The Markov chain = 0,1, .} is irreducible and aperiodic 


Explanation A Markov chain is irreducible if all states communicate, i e , every 

(tl) 

state can be reached from every other state Let 7r]jt denote the n step 
transition probability, then the state k can be reached from state j if and only 
if > 0 for some n > 1 Thus the Markov chain is irreducible if > 0 for 
some n > 1 Vj, A: G 2^ By using the above expressions of the state transiton 
probabilities, it can be easily verified that the Markov chain {£,, * = 0, 1, } is 

irreducible 

An irreducible Markov chain is aperiodic, if > 0 for some state j This 
holds for the Markov chain under consideration Thus {4,* = 0,1, } is 

irreducible and aperiodic 
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5.4 Ergodicity of the Markov Chain 

In this section, we find the conditions for the ergodicity of the Markov chain 
{/„? = 0,1, } We first state the following Lemma due to Fakes [54] which 

will be used to establish the ergodicity 

Lemma 5.4 Let {Xn,n = 0,1, } be an irreducible aperiodic Markov chain having 

as state space, the nonnegative integers Let dy be the drift at state j which is defined 
as 

dy = E[X,+,-X,\X, = j] (5 27) 

Then for all j if \dy\ < oo and if limsup^_^d^ < 0, then {X„,n = 0,1, } Js 

ergodic 

Theorem 5.2 The transmission epoch length Markov chain {4,* = 0,1, } is 

ergodic for a < l/N 

Proof We know from Section 5 3 that the chain {4, * = 0, 1, } is irreducible 

and aperiodic The drift at state j is given by 

dy = E[i^+l - 4 1 4 = j] 

= E + 1 _ (f- ~^ + I ~ 

The last equation can be written by making use of the fact that L''{N,n) - 

E^=i hKih) 

Hence we have 

d. = + 

^ 1 - (1 - 

= + E h) + (1 “ ^ 

n=l 

= j((Tiv - 1) + (1 - + E I 
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Since TV IS the total number of unresolved users at the beginning of the epoch, 
we have 

L^{N,l) = 1 L^{N,N) = N 

and L''(TV, u) < TV for 2 < n < iV - 1 

Hence from Equation 529 we have 

dj < AT + (1 - + ^(crTV - 1) 

< |TV| + |(l-a-y'^| + b(aTV-l)| 

< '^3 (5 30) 

This satisfies the first condition of the Fakes lemma Now we have to show 
that lim sup^ < 0 Let 

AT, = TV + (1 - cry^ - 3{l - aN) (5 31) 


Then we have 


dj < Mj 

and also sup{d^,(i^ 4 .i, } = M, 

If (tTV < I, then from Equation 5 31 limj_ooTWj = -oo and hence we have 

lim sup dj = lim AT = — oo <0 (5 32) 

Hence the Markov chain {/„« = 0, 1, } is ergodic for aN < 1 or cr < 1/TV 

This establishes the result 

Remark 5.4.1 The above result is independent of any collision resolution al- 
gorithm as long as the expected collision resolution length L‘^{N, n) is bounded 
In our case if the total number of unresolved users at the beginning is TV, 
then < TV Similar result has been obtained in [76] in the context of 

a different multiple access protocol 
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5.5 Steady State Probabilities and Expected 
Transmission Epoch Length 

5.5.1 Procedure for Computations 

Let TTfcS denote the steady state probabilities of the transmission epoch lengths, 
le , 

TTi = hm = lim Prob[l, = k] = Prob[ioo = k] 

>Ou %- >oo 

Since the Markov chain is ergodic, the steady state probabilities tt^s can be 
calculated by solving the following system of linear equations 

OO 

OO 

and X] ~ ^ 

A=1 

Let TT = [7ri,7r2, ] be the steady state probability vector and n be the 

state transition probability matrix, then the above equation can be written in 
the matrix form as 


TT = iriJ 

OO 

Y.”" = 1 <5 34) 

The state transition matrix can be evaluated with the help of Equation 
5 7 for given values of cr and N Since the matrix iJ and the steady state 
probability vector tt are of infinite dimension, we truncate the probability 
vector and the state transition probability matrix to some finite dimension T 
to evaluate the steady state probability vector numerically The appropriate 
value of T depends upon a and N and is to be chosen carefully so that the 
effect of truncation error is small 

While truncating the state transition probability matrix i7 = [7r_,,jt] to some 
finite dimension T, for j varying from 1 to T is set equal to (1 — '^j,k) 

The truncated system of equations ttt = tttII and 53^=1 tti; = 1 can then be 
solved to give the probability vector = [7ri,7r2, ,'^t] 
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To solve this truncated system of equations, we use the iterative procedure 
[84, 53] It IS well known [46] that the iteration 

= TTf i7 (5 35) 

will converge to the steady state probability vector ttt independent of the 
starting value In numerical computations, the iteration is stopped when 
the following error criterion is satisfied 

I — n+1 _n 1 ^ ^ 

I ^T' I \ 6 


where e is the specified tolerable error 

After calculating the steady state probabilities, the expected transmission 
epoch length and the second moment of the epoch length under steady state 
conditions are given by 


00 


= E[ioc] = 


(5 36) 


A:=l 


= EiO = 

00 

k=l 

(5 37) 


5.5.2 Numerical Results 

For the numerical calculations, we assume the number of users N to be 
equal to 8 For N = 8, the system is stable for arrival probability a less 
than 1/N = 0 125 We calculate the steady state probability vector and the 
expected epoch length for various values of arrival probability a from 0 01 to 
0 1 for the truncated system The choice of the truncation size is different for 
each arrival probability and is selected such that the expected transmission 
epoch length (and expected delay computed in Section 5 6) calculated by the 
truncated system remain unaltered to at-least three decimal places, even when 
larger truncation size is used Hence for each cr, we find out the appropriate 
truncation size The values of truncation size for different arrival probabilities is 
given in Table 5 1 The size of 40 is considered sufficient for arrival probabilities 
less than 0 05 As the value of the arrival probability increases, the required 
truncation size also increases The expected transmission epoch lengths and 




Figure 5 1 Expected Epoch Lengths 
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the second moments of the epoch length calculated by the truncated system 
are given in Table 5 2 For the arrival probability o greater than 0.04, the 
expected epoch length increases very rapidly 

Table 5 1 Truncation Size Chosen versus Arrival Probability 


Arrival 

Probability 

o 

Truncation 

Size 

0 01 

40 

0 02 

40 

0 03 

40 

0 04 

40 

0 05 

50 

0 06 

50 

0 07 

50 

0 08 

60 

0 09 

80 

0 10 

100 


lable 5 2 Expected Value and Variance of Transmission Epoch Length 


Ann al 
Probability 

a 

Expected Transmission 
Epoch Length 

Loo 

Second Moment of 
Epoch Length 

Ll 

Variance of 
Epoch Length 

0 01 ' 

10930 

13154 

01207 

0 02 

12259 

1 8892 

0 3863 

0 03 

14402 

31046 

10304 

0 04 

18519 

6 3005 

2 8709 

0 05 

2 8503 1 

17 2353 

91110 

0 06 

5 7564 

62 0114 

28 8752 

0 07 

12 5083 

206 4339 

49 9763 

0 08 

20 3183 

4524637 

39 6303 

0 09 

27 9662 

826 0169 

43 9085 

0 10 

39 8011 

1666 0550 

81 9254 


We know that the tiansmission epoch length consists of the collision reso 
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lution part and the successful packet transmission part, t e , we have 


? _ f ^241 + for 77,+] > 1 

1 1 for 7?,+, = 0 


The corresponding expected values are given by 


(5 38) 


£^[^00 I Jloo = n] = 7i) + £^(7V, n) for 71 > 1 

E[ioo I »7oo = 0] = 1 


(5 39) 
(5 40) 


Thus £'[£00] can be written as 


£[^00] 


N 


= n) + Ll{N, n))p(n) + p(0) 

= £^ + L:,+p(0) 


(5 41) 


where p(n) = Proh{'q^ = n) is the probability that the number of actve users 
at the begmnmg of the transmission epoch under steady state condition is n 
and it IS given by 

00 

Pi-Hoo = n) = p(7r I j/)7r^ (5 42) 

7=1 

The value of can be calculated as 

00 N 

= (543) 

]=l n=l 

We note that £^ is the total number of packets transmitted successfully in a 
transmission epoch Thus the ratio i^/Too gives the number of packets trans- 
mitted successfully per slot under the steady state operation or the throughput 
of the buffered system under the operation of our protocol Similarly is the 
number of slots "wasted" in collision resolution in a transmission epoch The 
values of and are given in Table 5.3 The ratio £^/£oo is a measure of 
the collision resolution efficiency of the protocol We call it the resolution factor 
of the protocol Note that^more the value of this resolution factor,^ greater wilT 
he the slots used in collision resolution m a transmission epoch 

Now consider a TDMA system In TDMA, there is a frame of N slots and 
each slot corresponds to a user The user can transmit only one packet per 
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frame If o is the arrival probability, then the throughput of the TDMA system 
IS NajN = a Similarly, the average number of slots wasted in a TDMA frame 
can be shown to be equal to iV’(l — cr) and thus iV(l — <7’)/iV can be considered 
as the resolution factor of the TDMA system Table 5 4 gives these values for 
different arrival probabilites for both the systems 


Table 5 3 Expected Length of Collision Resolution & Successful Packet Trans- 
mission Part 


Arrival 

Probability 

cr 

Expected Length of 
Collision Resolution 
Part 

Expected Length of 
Successful Packet 
Transmission Part 

Llo 

0 01 

0 0893 

0 0875 

0 02 

0 2059 

01962 

0 03 

0.3741 

0 3458 

0 04 

0 6582 

0 5933 

0 05 

1.2535 

1 1448 

0 06 

2 7118 

2 7849 

0 07 

5 3773 

7 0570 

0 08 

7 2596 

13 0520 

0 09 

7 8117 

20 1544 

010 

7 9571 

39 8440 


Remark 5.5.1 The problem of approximatmg the steady state probability vec- 
tor of an infinite Markov chain by the steady state probabihty vector of a finite 
Markov cham arises in wide variety of problems Some authors [15] have stud- 
ied general methods for solvmg the steady state balance equations Heyman 
[29] has derived sufficient conditions which imply that as the truncation size n 
tends to infinity, the stationary distribution of the truncated chams converge 
to the stationary distribution of the given chain In the context of multiple 
access protocol, Nakasis and Ephremides [53] has encountered this problem 
while calculating the queue size distribution of buffered ALOHA By utilizing 
the concept of dominant chain and by exploiting the particular nature of the 
problem, they have given a method to approximate an infinite Markov chain 





Arrival Probability, <t 


Figure 5 2 Throughput for Buffered and TDM A Systems 
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Table 5 4 Resolution Factor & Throughput 


Arrival 

Prfihability 

a 

Throughput of 
Buffered System 

Resolution 

Factor of 
Buffered System 

•^oo/ ^OO 

Throughput of 
TDMA System 

Resolution 
Factor ol 
TDMA System 

0 01 

0 080 

0 076 

0 01 

0 99 

0 02 

0 160 

0 167 

0 02 

0 98 

0 03 

0 240 

0 259 

0 03 

0 97 

0 04 

0 320 

0 355 

0 04 

0 96 

0 05 

0 401 

0 439 

0 05 

0 95 

0 06 

0 483 

0 471 

0 06 

0 94 

0 07 

0 564 

0 429 

0 07 

0 93 

0 08 

0 642 

0 357 

0 08 

0 92 

0 09 

0 720 

0 279 

0 09 

0 91 

0 10 

0 800 

0199 

0 10 

0 90 


In our numerical examples, we have used a technique similar to the one 
used by Wieselthier and Ephremides [84] In our analysis, the steady state 
probabilities are finally needed to calculate the expected transmission epoch 
length and the expected packet delay Both have an accuracy of at-least three 
decimal places for all arrival probabilities considered here This is considered 
sufficient for our purposes 

5.6 Packet Delay Analysis 

As explained in Chapter 2, the delay encountered by a packet is defined as 
the time from the moment of its generation to the moment of its successful 
transmission Note that m the operation of our protocol, the packets generated 
in one transmission epoch are transmitted successfully in the next epoch To 
calculate the average packet delay, we assume the steady state operation of 
the protocol 

Let us choose a packet randomly in an epoch and tag it Suppose that our 
tagged packet has arrived in ^th epoch and transmitted in (i + l)th epoch The 
packet arrival at any user in a slot is assumed to take place at the beginning 
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of the slot Let n be the number of active users at the begmning of {i + l)th 
epoch Then ith epoch is called the arriving epoch and (^ + l)th epoch is 
called the departing epoch The active user which contains the tagged packet is 
referred as the tagged user 

Let 6 be the delay of the tagged packet as shown in Figure 5 3 Then 


PACKET ARRIVES 

A 


4-4 


PACKET DEPARTS 

A 


+ 






ARRIVING EPOCH 


DEPARTING EPOCH 


Figure 5 3 Delay encountered by a Packet 

6 = 6 ° + 6^^ (5 44) 

where 6“ and 6“' are the delays encountered by the tagged packet in the 
arriving epoch and the departing epoch respectively Both 6“ and 6°^ are 
random variables The expected packet delay is 

E[6] = E[6^] + E[6^] 

V = IT + (5 45) 

where V, V°- and are the expected values of b, 8°- and 8^ respectively 
Let 8“^ and the components of the delay in the departing epoch, be 
defined as follows 

= The delay due to the packets of other users which transmit before the 
tagged user plus the delay due to the collision resolution subsection of 
the tagged user 

6^ = The delay due to those packets of the tagged user which are ahead of 
the tagged packet 
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Since the delay due to HOL packet of the tagged user is already accounted 
in we subtract one slot unit time from 6^ is then given by 

6-'= if +(«,"-!) + 1 (546) 

The last one is added to account for the tagged packet transmission time which 
is one slot unit The corresponding expected values can be written as 

©t = + (547) 

The delay T> is therefore given by 

P = (5 48) 


5.6.1 The Delay Components and Vg 

Before we calculate the delay and V^, we state the following lemma 


Le mm a 5.5 Let p{£a = j) be the the probability that the length 4 of the arriving 
epoch IS j Then p(£a — j) ts given by 


Pifa = 3) 


J Prob(£oo = j) ^ 

E[^^] Loo 


(549) 


Proof The proof of this lemma follows from renewal theory Under the steady 
state operation, startmg instants of the transmission epochs form renewal 
instants Klemrock [37] has given the relationship between the probability 
of the selected interval in terms of the probability of a typical interval The 
interval selected here is the arriving epoch The typical epoch length under 
steady state is represented by i^o Thus following [37], we can establish the 
above relationship □ 

The followmg theorems enable us to evaluate V°- and 


Theorem 5.3 The expected delay V°- is given by 

__ E[tU + E[ioo\ 

2E[/oo] 


(5 50) 
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where Ef/ou] ond £'[/^] are the first and second moments of the transmission epoch 
length under steady state operation and are given by Equation 5 36 and Equation 
5 37 


Proof Let be the expected delay in the arriving epoch when the length 
of the epoch is j Then can be expressed as 

OO 

I>“= = (551) 

7=] 

The delay of the tagged packet in the arriving epoch of length j can vary 
from 1 slot to j slots depending upon its arrival As proved in Appendix B, 
the probability that the tagged packet has delay of k slots is 1/j for all values 
of k from 1 to j; The expected delay is therefore given by 


V^(j) = E[6‘^\L = 3] 

J k=l 


(5 52) 


Substituting for V°-(j) from Equation 5 52 and p{£a = j) from Equation 5 49 
into Equation 5.51, we get 


U 2E[C] 

E[e^] + E[£oo] 

2E;[£oo] 


(5 53) 


This result can also be proved by considermg that the delay m the arriving 
epoch IS equivalent to the residual life m an renewal epoch 


Theorem 5.4 The expected delay Pf is given by 

2E[ioo] 


(5 54) 
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Proof The delay is the expected delay due to other packets of the tagged 
user which are ahead of the tagged packet Let PfO) expected delay 

conditioned on the length of the arriving epoch being equal to j Then similar 
to Equation 5 52, we can write for 72^ as 

OO 

= (555) 


The delay PfO) is equal to the expected number of packets generated 
before the tagged packet when the length of the arriving epoch is j Since a 
user generates a packet with probability <t m each slot, the expected number 
of packets generated before the tagged packet is o times the expected number 
of slots occurring before the tagged packet in the epoch If the length of 
the arrivmg epoch is j then the number of slots occurring before the tagged 
packet varies from 0 to j - 1 with equal probability of 1/j Hence we have 


1 

J k=0 

^ - 1) 
2 


(5 56) 


Substituting Equation 5 56 and Equation 5 49 into Equation 5 55 we get 


' 2 EHoo] 

<r{ElfJ - EV^]] 
2E\U 


(5 57) 


This proves the theorem 


□ 


5.6.2 The Delay 

The delay consists of two parts One part is the expected delay due to the 
packets of other users which transmit before the tagged user This part consists 
of the collision resolution subsection and the successful packet transmission 
subsection of each of these other users The other part is due to the collision 
resolution subsechon of the tagged user 
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Like all transmission epochs, the departing epoch can be divided into n 
sections, if the number of active users at the beginning of the epoch is 71 
At the end of the first section, all unresolved users are reindexed as 1,2, 
etc in the order of their increasing address indices It can be shown then 
that the deparhng epoch has several epochs nested into it For example, if 
the departing epoch has state (TV, n) at the beginnmg and state (Tkf, n — 1) at 
the end of the first section, where M < N, then a new transmission epoch 
with initial state {M, n — 1) may be assumed to begin Thus the deparhng 
epoch may be seen to consist of a transmission section and a new transmission 
epoch Let 

^"0, N, n) = E[St I 4 = s{0) = (TV, n)] (5 58) 

I e V^{j,N,n) IS the expected value of conditioned on the event that the 
length of the arriving epoch is j and the initial state of the system employing 
the collision resolution algorithm is (TV,n) 1?^ is then given by 

CO N 

= =j) (5 59) 

7=1 n=0 

where r]d is the number of active users at the beginnmg of the departing epoch 
and 4 IS the length of the arnvmg epoch From the above equahon, we have 

00 N 

= ri)p(r)d = n I 4 = j)p{L = j) (5 60) 

7=1 n=0 

Since cr IS the arrival probability, we have 

Pfe = n I 4 = j) = P’'(l - P)"-” (5 61) 

where p = 1 — (1 — cr)-' 

Here p(4 = j) is the probability that the length of the epoch in which the 
tagged packet has arnved is j and can be calculated from Equation 5 49 In 
Equation 5 60, we have to calculate now V^(j, TV, n) 

If we focus only on the collision resolution part of the epoch, after ignoring 
the successful packet transmission part, then the state reaching probability is 
defined to be the probability that the system ever reaches the state (Tkf, n - 1) 
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from the state (iV, n) Let this be denoted by 7{(7\r, n), (M, n — 1)} Let 
/3{(Af, rj), (M, n — l),f} be the probability that the system reaches the state 
(M, 71 — 1 ) from (N, n) in / slots We then have 

OO 

7 {(W, n), (M, n-l)} = Y, n), (M, n - 1), £} (5 62) 

e=i 

In the above expression {f3{{N,n),{M,n - !),£} can be interpreted as the 
probability distribution of the colhsion resolution subsection of the first section 

We then have the following two lemmas 


Lemma 5.6 Let p (#*) denote the state transition probability from the state 

(N, n) to (M ] , ni) when optimal control policy is employed and 'y{(N, n), (M, n - 1)} 
be as defined above, then ‘y{(N,n),{M,n — 1)} can be recursively computed by the 
following expression 


7 {(N, n), (M, n - 1)} = + E 


(5 63) 


where Em = {(Mi,ni) Mi 7 ^ M,ni 7 ^ n — 1 } 


Proof The proof is straightforward From the state {N,n), the Markov chain 
characterizing the collision resolution algorithm goes either to the state (M, n— 1) 
and thus reaches the desired state or it goes to some other state (Mi,ui) with 
the probability p and from the state (Mi,ni), eventually the state 

{N,n),{Muni) 

(M, n - 1) is reached with probability 7 {(Mi, nf), (M, n - 1)} □ 


Lemma 5.7 Let L''^{N,n) be the expected length of the first collision resolution 
subsection of the epoch having state (N, n) at its beginning Let n) be the 

expected length of the collision resolution part of the entire epoch having state (N, n) 
at its beginning, then (TV, n) is given by the following equation 

(AT, n) = U{N, n)-Y, n - l)7{(iV, n), (M, n - 1)} (5 64) 

Xu 


where Mm = (5{{N,n),{M,n - 1),^} > 0} 
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Proof Let for j = 1,2, ,n denote the time instant where the jth section of 
an epoch ends and S(Tj) denote the state of the system employing the collision 
resolution algorithm at the instant Let [ 5(T]) = {M,n - l),r^ = 

f) denote the expected length of the collision resolution part of the epoch 
conditioned on the event that the first collision resolution section is of length 
£ and the state at the end of the section is (M,n — 1) We can then write 

L^{N, n I S{Ti) = (M, n - 1), = f) = £ + n - 1) (5 65) 

By unconditioning we get 

U{N,n) = 5: X^£/3{(7V,n),(M,n -!),£} 

i Xm 

+ 5: L\M, n - l) 7 {(Ar, n), (Af, n - 1)} 

= (N, n) + ^ L^{M, n -!)'){ {N, n), (M, n - 1)} (5 66) 

Tm 

Hence we have 

(N, n) = L\N, n)-Y, L\M, n - l)j{iN, n), (M, n - 1)} (5 67) 


Definition 5.2 If any active user transmits successfully its HOL packet in the 
collision resolution subsection of any transmission section, it is said to be a winner of 
that section □ 

Let ai{N, n) be the probability that our tagged user is the winner m the first 
section of the epoch which has the state (N, n) at its beginning Because of the 
nature of our collision resolution algorithm, any of the active users is equally 
likely to be the winner at the end of the collision resolution subsection of the 
first section So the probability that the tagged active user is the winner in 
the first section of the epoch, when there were n active users at its beginning 
IS just equal to 1/n Hence ai{N,n) = 1/n We can now prove the following 
theorem which enables us to compute T>^(j, N, n) 
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Theorem 5.5 'D‘^(j,N,n) can be recursively computed by the following expression 

VfXhN^n) = U^{N,n) + {l-a^{N,n)) 

, _ r „ + Y.'Piil’M.n - lhUN,n).{M,r, - 1)} 

/ 

(5 68) 

where L^^{N,n) and 7{(7V, 77), (M, n — 1)} are as defined earlier The set Xm ts the 
set of all M such that 'y{(N,n),{M,n - 1)} > 0 

Proof By definition we have 

Viij, N, n) = E[St \£a = J, S{0) = {N, n)] (5 69) 


Therefore 

vtlj, N, n) = E[ E[6t \L= 3, S(0) = (N, n), S(%) = (M, n - 1), T ] 

= B[I>^(?,N,n|M.n-l,0] (570) 

Here V^(j,N,n | M,n — l,i) is the expected delay V'^{j,N,n) conditioned on 
the event that state at the end of the first section is (M, n - 1) and the length 
of the first collision resolution section is I For convenience, let this event be 
denoted by Em/. 

The delay 6^ is a random variable and its value conditioned on the event 
Em/ can be written as 

8%, N, n I M, n - 1, £) = n) + (1 - oc,{N, n)) (£ + + 6t(j, M, n - 1) ) (5 71) 

This equation states that is equal to the length of the first collision resolution 
subsechon, if our tagged user is the winner of the first section which occurs 
with probability ai(iV, n) Otherwise it is equal to the length of the entire first 
section plus an additional delay Sf(j, M, n - 1) After the first section, a new 
epoch may be assumed to begin with the initial state (M, n — 1) and the delay 
6^{M,n - 1) IS the delay in this new epoch which is nested into our departing 
epoch 
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By taking expectation on both sides of Equation 5 71 we have 

I M, n-l, /) = / + (!-«, (N,n))|:j — M,n - 1)] (5 72) 
By unconditioning we get 

Vtij,N,n) = J2JlWN,n),{M,n-l)J} + {l-ay{N,n)) 

i Xm 

^ + E E /3{(M (M n - 1), t}vHj, M.n-l) 

= L‘'(N,n) + {l-a,(N,n)) 

+ E ®"(J. M,n- l)7{(Ar, n), (M, n - 1)} (5 73) 

This recursive equation can be solved to yield 'D^(j,N,n) with the initial 
condition V^{j, M,l) = 1 VM □ 

5.6.3 Numerical Results 

After calculating the value of V^(j, AT, n) from Equation 5 68 and p{£a = j) 
from Equation 5 49 and substituting these values m Equation 5 60, can be 
calculated The expected packet delay is then the sum of Va, and The 
expected packet delay can thus be computed for various arrival rates for a 
given user population The expected packet delays are given in Table 5 5 for 
N = 8 

We will compare these packet delays with the corresponding delays for 
specific polling type of protocol which is a variant of TDMA for buffered 
users Before we perform the complete delay analysis of this protocol, the 
question before us is why we should choose this protocol for comparison 
Tsybakov [75] has considered the broad philosophical framework under which 
different multiple access protocols can be compared We take a brief look at 
this work and then proceed to the delay analysis of the polling protocol and 
Its comparison with the protocol considered above for buffered users. 
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Table 5 5 Packet Delays for Buffered Users 


Arrival 

Probability 

a 

Delay 

Component 

Average Packet 
Delay 

V 

0 01 

0 0986 

1 2014 

0 02 

0 2610 

1 5369 

0 03 

0 5636 

21588 

0 04 

1 1917 

3 4407 

0 05 

2 5440 

61935 

0 06 

4 9808 

11 1602 

0 07 

7 9170 

17 2115 

0 08 

10 7286 

23 2137 

0 09 

13 9961 

30 5483 

010 

19 2844 

42 7572 


5.7 Polling Protocol 

5.7.1 On Comparison of Multiple Access Protocols 

As mentioned by Tsybakov [75], the multiple access protocols can be broadly 
divided into two types for comparison 

• Station or User Control Protocols 

• Packet Control Protocols 

1 User Control Protocols Station or user control protocol establishes in what 
sequence and for how long the users may occupy the channel According 
to this protocol, at any moment t, when a particular user occupying the 
channel releases the channel, the nght to occupy the channel passes to 
another user whose address is determined by the protocol 

The efficiency of such user control protocols is low when a large propor- 
tion of time IS wasted in passing the right to users that have nothing to 
transmit Systems with user control protocols are various time sharing 
systems, polling systems 
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2 Packet Control Protocol In packet control protocols, the protocol controls 
the transmission of the first packet queued in the buffer The protocol 
determines the time instants when the transmission of the particular 
packet starts and ends For a given packet of a user, these moments may 
depend on the previous starting and ending moments of the previous 
packets of that user They may also depend sometimes upon the queue 
length information 

Although the collisions are unavoidable in such protocols, the efficiency 
of packet control protocols is generally high, when the users have bursty 
type of traffic The protocols in this category try to gain information 
through collision slots and at the same time, the objective of the protocol 
IS to allow successful transmission of packets 

Qualitatively speaking, generally, the efficiency of packet control protocols 
IS high when the efficiency of user control protocols is low and vice-versa 
Note that our access protocol described in this chapter belongs to the category 
of packet control protocol We therefore consider a variant of TDMA for 
buffered users which is a user control protocol The comparison of these two 
protocols lead to the conclusions about the relative performance of user control 
protocol over packet control protocol on a quantitative basis The comparison 
criterion chosen is the expected packet delay 

5.7.2 Description of Polling Protocol 

In this section, we discuss a polling protocol for finite buffered users This 
protocol can be considered as a vanant of TDMA As before, we have a finite 
population of N users, each with a buffer of infinite size The packet arrival 
process to each user is a discrete time Bernoulli process and the probability 
of a packet arrival in any slot at each user is a The users are addressed as 
1,2, ,Ar 

As before, the operation of the protocol can be divided into successive 
transmission epochs The packets that arrived in one epoch are transmitted 
ji-^ the next epoch The protocol grants users the right to access the channel 



CHAPTER 5 BUFFERED USERS 


137 


in the order of their increasing address numbers Thus user addressed as 
1 transmits its packets first, user 2 next and so on till at the end, user N 
transmits If a user has nothing to transmit, it leaves the slot allocated to it 
as empty and the protocol gives the transmission right to the next user The 
user indicates the end of its packet transmissions by an empty slot in the end 
Thus in every epoch, there are N empty slots each corresponding to a user 
and at the end of each empty slot, the transmission right passes to the next 
user 

Let be the length of {i + l)th transmission epoch of this protocol This 
length is equal to N plus the total number of packets that arrived to the 
system in the previous epoch Thus 

=N + (5 74) 

where R^+i is the total number of packets present in the buffers of all the 
users at the beginning of (i + l)th epoch Note that the epoch length is always 
greater than or equal to N Since only the packets that arrived in the previous 
epoch are transmitted in the current epoch, the length of the current epoch 
depends upon the length of the previous epoch only Thus the sequence 
= 0,1, } is a Markov chain with state space {N,N + 1, . } 

5.7.3 Evaluation of State Transition Probabilities 

The state transition probabilities of the Markov chain = 0,1, } can be 

expressed as follows. 

Let be the probability of transition from the state j to the state k, le , 

q,,k = Pro6[Z.4i = k\Z, = j] (5.75) 

Since Z,+i = N + we have 

gy,k = FroblZ,+j = k I Z, = j] 

= FroblR^^j = k-NiZ, = j] (5.76) 

Assuming the packet arrival processes to different users to be independent 
of each other, Prob[R,+] = k - N j Z^ = j] can be written as the N'-fold 
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convolution of the probabilities of the number of packets in the buffers of the 
users Let (A]) be the probability that the number of packets in the buffer 
of rth user at the beginning of the epoch is A] given that the length of the 
previous epoch is j, i e , 

q^;\h) = PTob[b:^, = h,\z, = j] 

= (5 77) 

where bl_^_■^ is the number of packets in the buffer of user r at the beginning 
of (^ + l)th epoch But from Equation 5 76 

= Prob[R,+i = k - N \ Z,= j] 

= g\^\k -N)* qf\k -N)* * q^^\k - N) 

- n) ~ for N < k < N + Nj (5 78) 

where * is the convolution operator 

The transition diagram for this Markov chain is shown in Figure 5 4 If 
the Markov chain is m the state j at some mstant, then the next state will 
be C? + 1), C? + 2), etc depending upon whether one packet arrived or 
two packets arrived and so on, at the system If the present state is j, the 
maximum number of packets that can arrive is Nj, hence the next state in 
that case will be N(j + 1) 

5.7.4 Steady State Probability Vector 

Arguing along the lines similar to that of Section 5 4, it can be proved that 
the Markov cham = 0,1, } is ergodic Because of the ergodic nature 

of the Markov chain, we have a unique steady state probability vector Let 
q = [g;v,?Af+i, - ] denote the steady state probability vector, where qk is given 
by 

qk = hmProb[Z, = hi (5 79) 

x-->oo 



where k = N,N + 1, 
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Figure 5 4 State Transition diagram for TDMA for buffered users 


Note that go,9i, ,g^-i are zero Let Q denote the state transition prob- 
ability matrix of this Markov chain The steady state probability vector can 
then be solved by the following balance equations 


q = qQ (5 80) 

OO 

and = 1 (5 81) 

k=N 

The first and second moments of the epoch length are then given by 


E[Zoo] = E 

k=N 

OO 

and E[Zl^] = E 

k=N 


(5 82) 
(5 83) 


5.7.5 Numerical Results 

In this section, we perform the numerical calculations m a way similar to that 
of our earlier protocol for buffered users in Section 5 5 2 Thus we first calculate 
the steady state probabibty vector and the expected epoch length for different 
values of arrival probability for the truncated system The truncation size is 
chosen in a similar manner These sizes are listed in Table 5 6 The expected 
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length and the variance of the epoch length calculated by the truncated system 
are shown m Table 5 7 For comparison purposes we have shown the values 
of the expected epoch length from Table 5 2 Note that the epoch length for 
our TDMA type of polling protocol is always greater than the total number 
of users, / e , greater than 8 as these many number of empty slots will always 
be contained in any epoch for this protocol 

5.7.6 Expected Packet Delay 

As defined previously, the expected packet delay is the expected value of the 
delay of a packet which is the time from the moment of its generation to the 
moment of its successful transmission We proceed to calculate the expected 
delay along the lines of Section 5 6 

Thus as before, consider a tagged packet in the buffer of an active user 
at the beginning of an epoch Let the address of this user contaming the 
tagged packet be M Unlike our previous access protocol, where the delay 
of a packet is independent of the user's address, in this polling protocol, the 
expected delay is user dependent 

The delay of the tagged packet consists of the following parts 

1 The delay due to waiting in the arrivmg epoch, its expected value being 
denoted by P". 

2 The delay m the departing epoch due to the packets of other users which 
transmit before the user M, its expected value being denoted by V^^{M) 

3 The delay m the departing epoch due to other packets of the user M 
which are ahead of the tagged packet The expected value of this delay 
IS denoted by 

4 The transmission time of the tagged packet which is one slot unit time 
Let Pp(M) denote the total expected delay at the user M Then we have 

Pp(M) = P“ + + 1 (5 84) 
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Table 5 6 Truncation Size vs Arrival Probability 


Arrival 

Probability 

a 

Truncation 

Size 

0 01 

40 

0 02 

40 

0 03 

40 

0 04 

40 

0 05 

50 

0 06 

50 

0 07 

60 

0 08 

80 

0 09 

100 

010 

100 


Table 5 7 Expected Length & Variance of Epoch Length (Also shown in this 
table are the Expected Transmission Epoch Length values for our protocol for 
Buffered users) 


Arrival 

Probabihty 

cr 

Expected Epoch 
Length for Polling 

■2^00 

Variance of Epoch 
Length for Polhng 

Expected Transmission 
Epoch Length 

Too 

0 01 

8 6956 

0 6939 

10930 

0 02 

9 5238 

1 5328 

12259 

0 03 

10 5263 

2.6010 

14402 

0 04 

11 7647 

4.0280 

18519 

0 05 

13 3333 

6.0359 

2 8503 

0 06 

15 3847 

9 0244 

5 7564 

0 07 

18 1820 

13 8047 

125083 

0 08 

222231 

22 1879 

20 3183 

0 09 

28 5733 

38 9342 

27 9662 

010 

40 0039 

80 1229 

39 8011 
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We can state the following propositions which enable us to calculate and 

jyd 

P s * 


Proposition 5.2 The 


delay ts given by 


_ E[Zl] + E[Z^] 
^ 2E[Z^] 


(5 85) 


Proposition 5.3 The delay ts given by 

^ HEjZj] - E[Z^]} 
2E[Z^] 


(5 86) 


Proofs The proofs of these propositions can be carried out m a manner similar 
to that of Theorems 5 3 and 5 4 Note that theses delays are mdependent of 
the user's address □ 


Let the length of the epoch m which our tagged packet arrives be denoted 
by Za Let be the expected delay due to the packets of other users 

which transmit before the user M and conditioned on the length of the arriving 
epoch Za being equal to j Then V^j^M) can be written as 

00 

= E V‘p,,mp(Z, = 3) (5 87) 

where p{Za = j) is the probability that the length of the arriving epoch is j 
This probability similar to Equation 5 49 is given by 

p(Z. = j) = (5 88) 

E{Z,^\ 

Before the user M, a total of {M — 1) users will be given the rights to 
transmit Corresponding to each user, we have only one empty slot The 
average number of packets that have arrived in the previous epoch of length 
j in the buffer of these users and will be transmitted before the user M is 
j{M - l)cr Thus there is a total delay equal to the sum of M - 1 and — 
Hence we have 


= (M-1) + j(M-1)(7 
= {M-l)[l+ja] (5 89) 

By substituting the expression for V^^ j(M) m Equahon 5 87, V^J^M) can be 
calculated 
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Numerical Calculations of Packet Delay 

By calculating P", Pp, and the expected packet delay at the user 

M can be calculated from Equation 5 84 Unlike in the case of the protocol 
described earlier in this chapter, the packet delay for TDMA protocol for 
buffered users depends upon the user's address or index Note that the 
packet delay essentially has three components- out of which the two namely 
Pp and Pps, are independent of the user's address while the third component 
Pp^(M) depends upon the user's address Also note that the value of Pp^(M) 
is the delay due to other users which are ahead of the user M The value of 
this delay component for the first user is zero Thus the delay at the user 1 is 
simply the value of (P; + P^, + 1) The delay P^,(M) increases Imearly with 
the user's address 

Table 5 8 gives the values of P“, and for various values of 

arrival probabilities for M = 2 This table also shows the average packet delay 
at the user 2 The delay at the user 1 gives the best case delay for this 
protocol while the delay at the user 8 gives the worst case delay We compare 
these delays with the expected delays for the protocol employing the collision 
resolution algorithm These values are tabulated in Table 5 9 We note that 
below the arrival probability of 0 04, the delay due to the protocol employing 
the collision resolution algorithm (CRP) is better than that of the best case for 
the polling protocol 
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lable 5 8 Packet Delays due to Polling Protocol for Buffered Users 


Arrival 

Probability 

<7 

Delay 

P ps 

Delay 

ViSM = 2) 

Average Packet 
Delay 
-PAM) 

0 01 

10877 

49265 

7 0143 

0 02 

1 1936 

54292 

7 6229 

0 03 

13232 

60332 

8 3564 

0 04 

14842 

6775h 

9 2599 

0 05 

16892 

77126 

104018 

0 06 

19582 

8 9347 

11 8930 

0 07 

2 3258 

10 5985 

13 9244 

0 08 

2 8577 

129996 

16 8573 

0 09 

3 6942 

16 7700 

21 4642 

010 

5 2006 

23 5537 

29 7543 


Table 5 9 Comparison of Packet Delays 


Arrival 

Probability 

a 

Delay for 
CRP 

Best Delay for 
Polling Protocol 

Worst Delay for 
Pollmg Protocol 

0 01 

12014 

20877 

36 5732 

0 02 

1 5369 

21936 

40 1980 

0 03 

21588 

2 3232 

44 5556 

004 

3 4407 

2 4842 

49 9134 

0 05 

61935 

2 6892 

56 6774 

0 06 

11 1602 

29582 

65 5011 

0 07 

17 2115 

3 3258 

77 5153 

0 08 

23 2137 

3 8577 

94 8549 

0 09 

30 5483 

4 6942 

1220842 

010 

42 7572 

6 2006 

171 0765 





Chapter 6 


An Optimal Collision Resolution 
Algorithm for Multipacket 
Reception 


The previous chapters have discussed the random access algorithms for the 
conventional random access systems which can be modelled by the Common 
Receiver Model In such systems, when two or more packets are transmitted 
in a slot, they are destroyed In this chapter, we extend our discussion to 
random access systems with multipacket reception capability For this, we 
consider the CDMA-RA system model introduced in Section 2 61 In CDMA- 
RA system, even if two or more packets are transmitted m a slot, some of 
them may be received successfully The unsuccessful users may employ a 
collision resolution algorithm for retransmission In this model, the packets 
are transmitted by encoding them with codes chosen from a set of codes with 
low cross-correlation properties These are called address codes. As explained 
in Section 2 61, various schemes like transmitter based coding, receiver based 
coding and hybnd schemes are possible for assigning these addresses Here 
we consider a kind of transmitter based code assignment The CDMA-RA 
system can then be modelled by a Generalized Common Receiver Model 

In this chapter, we first discuss the assumptions made for the generalized 
common receiver model As in Chapter 3, we focus on the blocked random 
access algorithms for this generalized model Specifically, we address the 
question of determining an optimal collision resoluhon algorithm We extend 
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the formulation of optimal collision resolution algorithm of Chapter 3 to the 
generalized common receiver model Similar to that of Chapter 3, we define 
an appropriate state of the system and control variables that constitute a 
Markovian Decision Process and argue that the problem of optimal collision 
resolution algorithm is equivalent to the first passage problem of this Markovian 
Decision Process The dynamic programming technique is then applied to 
derive an optimal algorithm which minimizes the expected collision resolution 
length The algorithm is illustrated with numerical examples 

6.1 The System Model 

We consider a finite user common receiver model of CDMA-RA system as 
shown in Figure 6 1 There are many sources of bursty data traffic which send 



Figure 6 1 Generalized Common Receiver Model 

fixed length packets to the receiver through a common broadcast communi- 
cation channel These packets are, however, encoded with address codes as 
explained below The other assumptions about this model are 
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1 There are total N users m the system They are addressed as 1,2, , AT 

2 The slotted operation of the system is assumed 

3 Address Codes Each of the N users is equipped with a set of W orthogonal 

codes The number of orthogonal codes W is much smaller than the 
total number of users in the system {te , W N) Let this set of codes 
be denoted by {1,2, ,W} Each user before transmitting its packet, 

encodes it with one of the W orthogonal codes which is specified by 
the random access algorithm In this chapter, we have illustrated the 
random access algorithm with W = 2 The case of W > 2 can be easily 
generalized 

4 The common receiver has the decoder for all the W codes Thus the 
common receiver is in fact a bank of W receivers and each of them can 
receive packets transmitted using the respective codes 

5 The transmission of two or more packets in a slot using the same code 
results in collision at the receiver However, if only one packet is using 
a code in a slot, then that packet is received successfully Thus at-most 
W packets can be transmitted successfully in a slot if all these W packets 
are using the distinct codes 

6 Feedback Vector It is assumed that at the end of each slot, all users know 
about the state of the slot through feedback information The feedback, 
however, is assumed to be a W-dimensional vector Each element of 
this vector corresponds to a particular code and assumes ternary values 
of 0,1 or 2 depending upon whether no packet was transmitted, or only 
one packet was transmitted or more than one packets were transmitted 
on the corresponding code m the slot 

7 The feedback information is assumed to be received errorless by all users 

8 Blocked Access Operation We assume that the users employ the blocked 
random access algorithm As we know already that m blocked access, 
the operation of the system can be divided mto successive transmission 
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intervals called epochs In each epoch, the contending users resolve 
their collisions by using a collision resolution algorithm The packets 
generated in one epoch are transmitted in the next epoch 

9 Smgle Packet per Epoch Each user has only two buffers The first buffer 
contains the packet which is undergoing the collision resolution in the 
current epoch, while the second buffer stores any newly generated packet 
All other packets which are generated after this new packet, are assumed 
to be lost In other words, a user is assumed to generate and transmit 
only one packet per epoch 

10 Active Users As defined in Chapter 3, an active user is defined to be a 
user if it has a packet waitmg m its buffer for transmission We assume 
that the number of active users at the beginning of a colhsion resoluton 
epoch is known to all users 

6.2 Random Access Algorithm for CDMA-RA 
System 

We know from Chapter 3 that the collision resolution algorithm completely 
characterizes the blocked random access algorithm withm the class If 

the users transmit only one packet per epoch, then the colhsion resolution 
algorithm is given by the function /[«, 0(f)] The function /[ ] assumes bmary 
values of either 1 or 0 and it specifies whether the user ^ should transmit its 
packet at the instant f or not In other words, the algorithm can be specified 
by an ensemble where B(t) = {i /[*, 0(f)] = 1} 

In the same way, for the generalized common receiver model, the collision 
resolution algorithm can be defined by the function /[*, Ci, 0(f)] where i 
as before is the user's address and C, is the code to be used by the user 
* for encoding its packet The code C, can be one of the W orthogonal 
codes Thus the collision resolution algorithm for the CDMA-RA model can 
be specified by the ensemble {5(f)} where 5(f) = [5i(f), 52(f), ,Bw{t)\ and 

^ f[i,Q = r, 0(f)] = 1} Thus the collision resolution algorithm 
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specifies the set of users (for each address code) which are allowed to transmit 
their packets using the respective codes 

Our interest in this chapter is in the determination of the optimal collision 
resolution algorithm for the generalized common receiver model But before 
we show how to determine this algorithm, we first study the dynamics of our 
system For this, we define the state of the system 

6.2.1 The System State 

We first generalize the definition of a resolved user in this section 

Definition 6,1 A user ts said to be a resolved one ij one of the followings conditions 
IS obtained 

1 It IS known to all other users that the user does not have a packet 

2 The user was enabled in a slot with some code and this code was used by at-most 
one packet for transmission 

Suppose some users are enabled to transmit with the same code If only 
one of these users has a packet, then the position in the feedback vector 
corresponding to this particular code would indicate a success Thus, though 
the identity of the user having a packet does not become known to all other 
users, these users are treated as resolved Similarly, the users enabled to 
transmit with some different code may get resolved The total number of 
resolved users would be equal to the sum of the users resolved on each code 

As in Chapter 3, the state of the system at the instant t is defined to be 
a two tuple S{t) = [iV(f),n(f)] where as before, N{t) is the total number of 
unresolved users and n{t) is the total number of active users at the mstant t 
If the number of active users at the beginning of a collision resolution epoch 
IS n, then since all users are unresolved at the beginning, we have the state 
5(0) = (iV,n) 
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6.2.2 Dynamic Evolution of the System State 

The collision resolution algorithm for the CDMA-RA system can be considered 
as a control policy This control policy comprises a sequence of control actions 
to be taken at each stage However, for this generalized system, the policy 
specifies the number of users to be enabled separately for each code 

Let {S(t),t = 0, 1, } denote the sequence of observed states Let { U{t),f = 

0, 1, } denote the sequence of control actions taken Since we have assumed 

that there are W orthogonal codes, the control action at any instant is a W— 
dimensional vector Thus the control U{t) at the instant t is given by U{t) = 
[ui(f), n 2 (f), ,uwit)] where Ur{t) is the number of users enabled to transmit 
at the time t using the code r Let {6{t),t = 0,1, } denote the sequence of 

observed feedbacks The feedback 6(t) is also a TT-dimensional vector and can 
be written as 0(t) = where each 0r(t)Wl <r<W assumes 

ternary values of 0, 1 or 2 depending upon whether no packet is transmitted, 
only one packet is transmitted or more than one packets are transmitted on 
the code r 

As in Chapter 3, let l{(Si) denote the set of admissible control actions when 
the state of the system is 5, = (iVi, n,) Then the set of admissible control actions 
consist of all such W tuples (ui, « 2 , , uw) such that U = Ui + U2+ +uw < 

and each Ur lies between 0 and iV, In other words, 

{ w 

(u], « 2 i • ) uw) = U < and 0 < < iV,, 'il <r <W 

r=l 

We also use the notation U{S{t)) to denote the set of control actions at the 
instant t 

To understand the evolution of the system state, we assume W = 2 Then 
the control action is C7(t) = [ui(t), U 2 (f)] L^f ^\{i) = “u '^ 2 (^) = ^2 and 
U = U 1 + U 2 This value U is then the total number of users to be enabled For 
this value, there will be many possible sets of users that can be enabled In 
the optimal collision resolution algorithm of Chapter 3, the users choose one 
such set randomly by using a pseudorandom number generator Thus similar 
to that of Chapter 3, the set of U users in which U] select the code 1 and U 2 
select the code 2 is also chosen randomly 
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By enabling these U users, a feedback + 1) = [e^{t + 1),02(^ + 1)] is 
observed Since each of these elements + 1) can take ternary values, 
6{i + 1) can take total of 9 values If 6](t + 1) = 02(f + 1) = 0, it means 
the enabled V] and V 2 users do not have any packet and they are treated 
as resolved and so the next state moves to {N^ - (u] + n,) Similarly, if 

9\(t + 1) = 1 and + 1) = 0, then it means that amongst the enabled V] 
users, only one user had a packet, while among the U 2 users, none had a 
packet so that uj and U 2 users are resolved and so the next state moves to 
{Ni — (u] + U 2 ), Ui — 1) In this way, we can describe the evolution of the system 
state 

The dynamic evolution of the system can be summarized m the following 
steps 


• The stochastic process consisting of the sequence of states {S(t) = 

[N(t),n{t)],t = 0,1, } IS called the core process 

• If n is the number of active users at the beginmng of the collision 
resolution epoch, then the mitial state S(0) = (N, n) is known to all users 

• The stochastc process consisting of the sequence of observed feedbacks 

= 0,1,. } IS called the observation process The feedback 0(t) is 
multidimensional For W = 2, 6{t) = 62(f)] 

• When the control U(t) = [ui(f),U2(f)] is applied at the time t, the state 
S{t) undergoes a transition to the state S{t + 1) and feedback 6(f + 1) = 
[61(f), 62(f)] IS observed 

• The probability of transition to the next state S{t + 1) depends only upon 

the present state ^(f) and the control action U(t) For a given sequence 
of control actions, the sequence {S(t),t = 0,1, } is a Markov chain 

The state transition probabilities can be evaluated as explained later 

• If the state S{t) is known, then by observing the feedback ${t + 1) and the 
control action t/(f), the state S{t + 1) can be determined exactly Since 
S{0) IS assumed to be known to all users, it follows that all users have 
perfect knowledge of the state at every stage 
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• The stochastic process { S(t), V(t), ( = 0,1, } 

action U{t) IS a Markovian Decision Process 


with the augmented control 


6.3 State Transition Probabilities 


(N 1 the probability of transition from the state S, = 

.llushaho7p!!|lpols''wrLktr'''\* 

calclateH / P ' 7' = 2 These probabilities can be easily 

V the con^°purtrb 

values 'he size of the admissible control 

Let , denote the probability of transition from the state 5. = 

o some state S, - (,N„n,), when the control applied is [ti, a,] We 

consider the following cases ^ 

' nrvt"«°t ^ ^ “"*™' ^PPLed IS then the 

or (0,0) (The probabilities of transitions to remaining states are zero) 
These probabilihes can be expressed as 



V 2 ; 

© 

(61) 

V,2),(u.2)(^^’“2) = 

© 

© 

(62) 

^{N,aUN, -U, -u2,2) ’ “ 2 ) = 


(6 3) 

70 


1 “2 

7) 7) 

(64) 

^(iV„2),(0,0)^^’’“2) = 

U 1 U 2 

71 

(6 5) 

U 2 IS equal to uj or then the probability of transition to 
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0^1,2) or (i/ 2,2) will be given by 


(2) 

V2),ta.2) for - "2 = ”I 






for Ni — Vi — U2 = U2 


(6 6 ) 

(6 7) 
(6 8 ) 


The probabilihes of transitions from (AT,, 2) to all other states will be zero 
This fact can be expressed as 




(6 9) 


for Nj ^ ui or ut or N^- ui- U2 and 7^ 2 or 1 or 0 


2 For n, = 3 When Uj = 3 and the control [m , U2] is applied then the next 
states can be (TV, — ui,3) or (iV, — 1x2, 3) or (iVj — ui — 1x2, 2) or (1x2,2) or 
(ixi,2) or — Ui — 1X2, 1) The probability of transition to these states can 
be written as 



("TO 

(610) 

("0 


("TO 

(611) 

(?) 

'(iV„3),(iV,-ui -u2,2) “ 

(ATj - 111 - U2){ui + U 2 ) 

(?) 

(612) 


(10“2 

(613) 

(?) 


(?)“■ 

(614) 

(?) 


Ui U2 

(?) (?) 

(615) 


The probabilities of transitions from (AT,, 3) to all other states will be zero 
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3 


4 


For 77 , 


= 4 For this, the state transition probabilities can be written as 



= 

ft )(?) 

("') 

( 616 ) 




( 617 ) 


("■) 

V , 4 ),( A .-.., 4 )(^”“^) 


(U2\ {Nt~Ui-V2\ 
1^T2^2 \j^J\ 4_r2 y 

( 618 ) 


(<) 

^( Ar ., 4 ),( 7 V ,- u 2 , 4 )^“’’“^^ 


^TZl (ui\ fN,-Ui~U2\ 

2^ri==2\riJ\ 4-ri y 

( 619 ) 


( t ) 

^(A.,4),(A.-ui-U2.2)^“^’“2^ 



(6 20 ) 


("■) 

^W,4),(A.-u,-22,3)^“’’^2^ 



(6 21 ) 


© fi-) 



2^r2=2 lVr2jv 3-r2 ) 

(6 22 ) 


G) 




(6 23 ) 


fi-) 





(6 24 ) 


For other cases The state transition probabilities from for other 

values of n, will be given by the following expressions 


p (ai^U2) 


^{N„n,),[N,-nun,y 


P 




{Ui,U2) 


(« 


— U] — U2 

n, 


C ) 

E ti2 /u2\ ^ Nt—Ui~-U2 

C ) 

y-Mtl /7/i\ /M— 'Ul— U2 
2^ri=2(rJV n,-ri 



) 

) 


(6 25 ) 
(6 26 ) 
(6 27 ) 
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U}ll2 


( - W .- U ] - U 2 \ 

V n .~2 ; 


C) 

(«| + "2)("';“'r') 

0 

E ^2 (u2\(N,~Ui 

72“ 2 ^ \T2/ W^t“l 


T2l —7/2 

r2 


C:) 

Er;.2«2 (:;)(«:",■:») 

C) 

E Ui '^>7^2 

ri =2 Z>r2=2 y^n y Vr2y V n, -rj -r2 / 

© 


(6 28) 
(6 29) 
(6 30) 
(6 31) 
(6 32) 


6,4 Determination of Optimal Collision Resolu- 
tion Algorithm 

As m Chapter 3, the collision resolution algorithm is a control policy and the 
optimal algorithm minimizes the expected time to reach the target state where 
all users are resolved Suppose a policy ^(c) is used Similar to that of Section 
3 41, we introduce a cost structure into our model Let W 2 ] be the 

expected cost incurred when the state is St and the control action is [ui,U 2 ] 

We define the cost ^ as follows 

!?'[5„ui,U2] = 1 V-S, 7^(0,0) anduuU2 eU{St) 
and S^[(0, 0),'Ui,'U2] = 0 (6 33) 

When the state (0, 0) is reached, then all users are resolved and the collision 
resolution epoch ends If we assume that P^qq) 
expected cost can be expressed as follows 

^#(c)(^(0) = = 

00 

EE E = St, u{t) = [ni , U 2 ] I 5(0) = (N, n)] 

nS^ = iNt,nt),Ul,'U2] (6 34) 
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The cost = {N,n)) is the expected collision resolution length The 

optimal collision resolution algorithm minimizes this expected collision reso- 
lution length 

As before, let y{c) denote the class of possible control policies for our 
generalized random access model and yoi^) t>e the subclass consisting of 
stationary deterministic policies Then similar to Theorem 3 2, we have the 
following proposihon 

Proposition 6.1 If the cost structure ts defined as in Equation 6 33, then there 
exists an optimal collision resolution algorithm which minimizes the expected collision 
resolution length This optimal control policy ^*(^) ^ stationary deterministic policy 

The optimal control policy can be computed by the following proposition 


Proposition 6.2 Let =0 [{<?}- (0,0)] Define the following 


Kn+iCS'.)^ mm 


^[S^,Ul,U2]+ 


5^(0 0 ) 




(6 35) 


then = c (S(0) = (N;,n.)) = L‘(N„n,) where f\c) G Vb 

T (c) 

minimizes C^^^j(-S'(0) = {N,n)) 


Proof The proof of these propositions can be carried out similar to those of 
Theorems 3 2 and 3 3 


6.4.1 Numerical Results 

Equation 6 35 can be solved iteratively and the optimal control actions can be 
computed for each possible state For the purpose of illustration, we consider 
N = 8 and TV = 16 The state transition probabilities can be calculated from 
Section 6 3 The iteration is performed using Equation 6 35 and is stopped 
when the following condition is satisfied 

|V„«(S,) - V„(S,)1 < 1 X 10-= 


ViSi E s 
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Table 6 1 Expected Collision Resolution Length and Optimal Control for N — 8 


State 


Expected Collision 
Resolution Length 


Optimal Control 


U] 


U2 


8 , 8 ) 
•8, 7) 
: 8 , 6 ) 
5) 
: 8 , 4 ) 
3) 

: 8 , 2 ) 
[ 8 , 1 ) 
(7, 7) 
(7,6) 

(7.5) 
(7,4) 

(7.3) 

(7.2) 

(7.1) 

(6.6) 

(6, 5) 

(6.4) 

(6.3) 

( 6 . 2 ) 
( 6 , 1 ) 

(5.5) 

(5.4) 

(5. 3) 

(5.2) 

(5.1) 

(4.4) 

(4.3) 

(4.2) 

(4.1) 

(3. 3) 

(3.2) 

(3.1) 

( 2 . 2 ) 
(2,1) 
n.ii 


4 000 
4 000 
3 857 

3 569 
2 977 

2 407 

1 571 
1 000 

4 000 

3 714 
3 400 

2 937 

2 348 

1 571 
1 000 

3 000 
3 000 

2 733 

2 350 

1 533 
1 000 

3 000 

2 600 
2 200 

1 500 
1 000 

2 000 
2 000 

1 333 
1 000 

2 000 
1 333 
1 000 
1 000 
1 000 
1 000 


1 

1 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 

4 

4 

1 

7 

1 

1 

1 

1 

1 

2 

1 

2 

2 

2 

3 

4 

1 

6 

1 

1 

1 

1 

1 

1 

2 

3 

3 

3 

1 

5 

1 

1 

1 

1 

1 

2 

2 

3 

1 

4 

1 

1 

1 

1 

to 

2 

1 

3 

1 

1 

1 

2 

1 

2 

1 

1 

1 

1 

0 

1 
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Table 6 2 
N = \6 


Expected Collision Resolution Length and Optimal Control for 


Slate 

Expected Collision 

Optimal Control 

Rasolution Length 

Ui 

U2 

(16,1) 

1 000 

1 

15 

(16,2) 

1 733 

8 

8 

(16,3) 

2 643 

6 

6 

(16,4) 

3 476 

4 

4 

(16,5) 

4 279 

3 

3 

(16,6) 

5 024 

3 

3 

(16,7) 

5 661 

2 

2 

(16,8) 

6 251 

2 

2 

(16,9) 

6 809 

2 

2 

(16,10) 

7 293 

2 

2 

(16,11) 

7 605 

2 

2 

(16,12) 

7 786 

2 

2 

(16,13) 

7 899 

2 

2 

(16,14) 

7 966 

1 

1 

(16,15) 

8 000 

1 

1 

(16,16) 

8 000 

1 

1 

(15,1) 

1 000 

1 

14 

(15,2) 

1 733 

7 

8 

(15,3) 

2 631 

5 

6 

(15,4) 

3 438 

4 

4 

(15,5) 

4 237 

3 

3 

(15,6) 

4 957 

2 

3 

(15,7) 

5 587 

2 

2 

(15,8) 

6 164 

2 

2 

(15,9) 

6 676 

1 

2 

(15,10) 

7 059 

1 

2 

(15,11) 

7 331 

1 

2 

(15,12) 

7 540 

1 

2 

(15,13) 

7 715 

1 

2 

(15,14) 

7 866 

1 

1 

(15,15) 

8 000 

1 

1 
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Cod fanned 


St ate 


Expected Collision 


Resolution Length 


12,1) 

1 000 

12,2) 

1 697 

12,3) 

2 572 

12,4) 

3 332 

12,5) 

4 019 

12,6) 

4 614 

12,7) 

5 171 

12,8) 

5 590 

12,9) 

5*817 

12,10) 

5 939 

12,11) 

6 000 

12,12) 

6 000 

11,1) 

1 000 

11,2) 

1 690 

11,3) 

2 511 

11,4) 

3 254 

11,5) 

3 953 

11,6) 

4 544 

:ii,7) 

5 018 

:ii,8) 

5 354 

:ii,9) 

5 609 

:ii,io) 

5 818 

[11,11) 

6 000 

(10,1) 

1 000 

(10,2) 

1 666 

(10,3) 

2 475 

(10,4) 

3 185 

(10,5) 

3 834 

(10,6) 

4 360 

(10,7) 

4 732 

(10,8) 

4 911 

(10,9) 

5 000 

fl0,10) 

5 000 


Optimal Control 


U] 

Uo 

1 

11 

6 

6 

4 

5 

3 

3 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

1 

1 

1 

1 

1 

1 

1 

10 

5 

6 

4 

4 

3 

3 

2 

2 

2 

2 

1 

2 

1 

2 

1 

2 

1 

1 

1 

1 

1 

9 

5 

5 

3 

3 

3 

3 

2 

2 

2 

2 

2 

2 

1 

1 

1 

1 

1 

1 
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Coniivucd 


Stale 

Expected Collision 
Resolution Length 

Optimal Control 

U] 

U2 

(9,1) 

1 000 

1 

8 

(9,2) 

1 638 

4 

5 

(9,3) 

2 463 

2 

3 

(9,4) 

3 127 

2 

3 

(9,5) 

3 756 

2 

2 

(9,6) 

4 193 

1 

2 

(9,7) 

4 523 

1 

2 

(9,8) 

4 777 

1 

1 

(9,9) 

5 000 

1 

1 


Table 6 3 Expected Collision Resolution Length for TV = 16 


State 

Expected Collision 
Resolution Length 

(16,1) 

1 000 

(16,2) 

1 733 

(16,3) 

2 643 

(16,4) 

3 476 

(16,5) 

4 279 

(16,6) 

5 024 

(16,7) 

5 661 

(16,8) 

6 251 

(16,9) 

6 809 

(16,10) 

7 293 

(16,11) 

7 605 

(16,12) 

7 786 

(16,13) 

7 899 

(16,14) 

7 966 

(16,15) 

8 000 

(16,16) 

8 000 1 





Chapter 7 
Conclusions 


With the widespread use of computer communication networks, there has 
been a considerable interest m the field of random access communication and 
several random access algorithms have been proposed However, most of 
these studies are not directed towards developing a theory of random access 
algorithms This may be attributed, in part, to the ever increasmg pressure of 
network designer community to come up with practically useful protocols 

A major contribution in random access communication has been made by 
Tsybakov [78] who looked at the structure of the information pattern available 
to the users and defined a class of random access algorithms by giving a 
formal notion of a random access algorithm for the infinite user model This 
thesis started with the mohvation of mvestigahng, in a similar manner, random 
access algorithms for the finite user model The focus of the thesis is limited 
to only a sub-class of these algorithms and one of the important conclusions 
IS that it IS possible to derive an optimal random access algorithm over this 
sub-class under a set of not quite unrealistic assumptions We summarize 
below some of the findmgs of the thesis to conclude our discussions 

Tsybakov 's definition of random access algorithm is the startmg point of this 
investigation We have given a unified review of random access algorithms 
within Tsybakov 's formulation We then define a random access algorithm for 
the finite user model It is shown how different random access algorithms 
can be classified using this definition It is not clear at present what kind 
of relationships exist between the class of algorithms for the finite user and 
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inhnite user model, though as remarked in Chapter 2 of the thesis, it is possible 
to give a general definition of a random access algorithm applicable to both 
finite and infinite user model 

The determination of an optimal algorithm over the entire class of random 
access algorithms is, in general, a very difficult problem We have therefore 
restricted our attention to only a subclass of these algorithms Our interest 
in this class is motivated by the appealing conjecture of Tsybakov that an 
optimal algorithm in this class is also optimal over the entire class for the 
infinite user model Another interesting aspect of the algorithms over this 
class IS that they can be shown to consist of a channel access algorithm 
and a collision resolution algorithm We have considered only those random 
access algorithms which employ the blocked channel access In other words, 
we have frozen the channel access scheme to be the blocked access a priori 
and thus the operation of the system can be divided into successive collision 
resolution epochs Furthermore, we have assumed that users can transmit only 
one packet per epoch We then systematically investigate collision resolution 
algorithm Two mam results are borne out of this mvestigation 

• Firstly, when the number of active users at the beginning of a collision 
resolution epoch is known, then it is shown that an appropriate set of state 
and control variables, that constitute a Markovian Decision Process (MDP), 
can be identified and the problem of optimal collision resolution algorithm 
IS equivalent to the first passage problem of this MDP It is shown that 
there exists an optimal algorithm which is a stationary and deterministic 
control policy that can be derived using dynamic programming technique 
We have illustrated the algorithm with numerical examples and presented 
the steady state analysis of this algorithm 

. Secondly, when the number of active users at the beginnmg is not known 
exactly but only probabilistically, then it is shown that the probability 
distribution of the state conditioned on the past mformation constitute 
the appropriate new state description Thus the finite user random 
access system is shown to have an alternative representation where 
the optimal collision resolution algorithm can be formulated as the first 
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passage problem with this new state Due to the computational burden 
in the implementation of this algorithm, we have not pursued this course 
further but suggested two suboptimal algorithms These algorithms arc 
based upon updating the conditional probability vector with the help of 
control action and observed feedback at each stage One of the algorithms 
(SOAl) chooses control action corresponding to the state which has the 
maximum value of probability while the other algorithm (SOA2) chooses 
control action corresponding to the expected state The performance of 
these algorithms is studied by simulations with different mitial probability 
distributions These probabilities are chosen to represent a range of 
users from lightly loaded to heavily loaded One of the important 
observations of these simulations is that the degradation in performance 
for the two suboptimal algorithms with respect to a bound on the optimal 
performance is not significant If the optimal algorithm, when the initial 
state IS known only probabilistically, were known then it would have 
performed worse than this bound It is therefore reasonable to conclude 
that these suboptimal algorithms are quite satisfactory 

We next considered the case of users with buffers The operation of the 
system can again be divided into successive transmission intervals called trans- 
mission epochs The head of the line packet (HOL) of each user participates 
in the collision resolution using the collision resolution algorithm mentioned 
above As soon as any of these HOL packets is transmitted successfully, the 
algorithm is interrupted and those packets of the user which were generated 
in the previous epoch are transmitted in consecutive slots The algorithm then 
starts again from the point where it is interrupted A detailed steady state 
analysis of this protocol is carried out It is shown that under certam condi- 
tions, the sequence of the transmission epoch lengths is an ergodic Markov 
Cham The steady state probabilities and the first and second moments of 
the transmission epoch length are numerically evaluated The packet delay 
analysis is then performed The expected packet delay consists of three com- 
ponents The expressions for evaluating each of these components have been 
derived A similar analysis is then carried out for a protocol which is a variant 
ol TDMA for buffered users and the superiority of the protocol employing 
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collision resolution algorithm has been demonstrated 

Finally, the thesis has dealt with random access channels with multipacket 
reception capability In such systems, even if two or more packets are trans- 
mitted in a slot, some of them may be received successfully Code division 
multiple access-random access (CDMA-RA) is an example. In such systems, 
the users encode their packets with pseudo — orthogonal codes When the 
coded packets are transmitted, then some may be received successfully The 
unsuccessful packets may require retransmission There are various schemes 
for assigning these codes As pointed out m the thesis, transmitter based 
code assignment scheme with a multibit feedback broadcast by the common 
receiver is a generalization of the common receiver model of the finite user 
random access system 

We have studied this generalized common receiver model where each user 
IS provided with a set of W orthogonal codes A user, before transmitting 
its packet, encodes the packet with one of the codes to be specified by the 
collision resolution algorithm We have considered blocked random access 
environment It is also assumed that the users can generate only one packet 
per epoch Then under the assumption of the number of active users at 
the begmning of a collision resolution epoch to be known, existence of an 
optimal algorithm is shown The optimal control actions can be computed by 
the dynamic programming equations analogous to that of the conventional 
finite user random access model These control actions specify the number of 
users to be enabled for each code The algorithm has been illustrated with 
numerical examples for representative number of users 

From our studies, several mterestmg possibilities for future research emerge 
Some of them can be outlined as follows 

• It would be of interest to investigate the relationship between the various 
classes of random access algorithms for the finite and the infinite user 
model 

• Our study is limited to the blocked random access algorithms We 
have not considered other channel access schemes bke free access The 
determination of an optimal algorithm with free access is an interesting 
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area for future research 

• We have shown in this thesis that when the number of active users 
IS known only probabilistically, the optimal collision resolution problem 
can be formulated in principle as the first passage problem of a Partially 
Observable Markovian Decision Process However, implementing this 
algorithm is computationally burdensome The determmation of optimal 
control actions with computationally feasible means is a topic for future 
research 

• We have considered two suboptimal algorithms SOAl and SOA2 We 
have not investigated whether other suboptimal algorithms with better 
performance exist 

• In the case of buffered users, we have adopted a strategy for accessing 
the channel and analyzed this strategy The determmation of an optimal 
strategy can be pursued as a future course of investigation 

• We have given a rather brief look at the channels with multipacket 
reception capability The thesis has considered only a limited case of 
transmitter based code assignment, since such a model can be shown to be 
a generalization of the common receiver model for the finite user random 
access system It would be mtereshng to consider other code assignment 
schemes and compare them with the transmitter based code assignment 
m relation to its advantages and disadvantages In this connection, we 
may use Time- Frequency code assignment scheme suggested m [13] for 
random access systems A preliminary investigation m this direcfaon has 
been carried out but not reported here 



Appendix A 

Proof of Existence and 
Determination of Optimal 
Algorithm 


In this appendix, following [11], we sketch the proof of Theorem 3 2 below 
Proof of Theorem 3 2 

We have assumed the initial state to be 5(0) = (AT, n) Consider the discounted 
cost 

OO 

n^(S(0) = (W,n),/3) = 

t=0 

OO 

= (Ai) 

t=0 

As proved in [11], there exists a policy 5 G T’n such that D^(5(0) = 
(A,n),/1) < Q^{S{0) = (JV,n),/3) for aU values of 5(0) G 5 and ^ near one 
Since lim/ 3 _,i 17^(5(0) = {N,n),(3) = we have 

OO 

C^(5(0) = (A,n)) = E^Y.nSitlu(t)) 

OO 

t=0 

< EE0ms{t),nm 

t=0 

OO 

= E^Y.^{Sit),u{t)) 

t=o 
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= C^{S{0)= {N,n)) (A 2) 

This proves the theorem ^ 

We now prove the Theorem 3 3 below To prove this theorem, we first 
state the following lemma 

Lemma A 1 («) = 1 Vw G Z^((0,0)), 5, = (iV„n,) and ° 

for some k >1, # G 3^d and (W„ nf) G <S then 


hm sup Pro6[S(t) (0,0) | S(0) = (Ar„ni)] = 0 

i — >cxj jg - ^ 

^ey 


Proof of Theorem 3 3 

This theorem states that let FoC'S'i) VP, G [{P} - (0,0)] be chosen arbitrarily 
Define the following 


W^+l(P^) = 


mm 

u&^{S,) 


ns^,v) + 


Y, P, , («)V™(5,) 

ij€5 ' ’ ^ 

i , 5^(0 0 ) 


(A3) 


then lim,„.oo^^(P0 = <^^*(^(0) = (Ar„n,)) = T^(A„n,) where G mini- 
mizes C^(S{0) = (A, n)) 

Let V^{S,) = C^*(P, = (A„n,) for P, G [{P} - (0,0)] Since is optimal 
and G 3^0/ we have ^^.(P,) = V^(S,) for m = 1,2, Let u, G A(P,) for 
G [{P} - (0, 0)] mmimizes the right hand side of Equation A 3, then we have 

for ni = 0, 1, , 




E Ps..s 


(A 4) 


Now assume that Kn(Pi) is the mth iterate of Vo(P,) If w, £ A(P,) is the 
control action minimizing the right hand side of the equation 


Wr,l(P,) 


mm 

ufJ-tiS,) 


^{s^,v)+ Y. 


i ,*(0 0 ) 


Ps„sS^)Vn{Sy) 


(A 5) 
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then we have for m = 0,1, , 


Khi(S.)-Khi«)< E MIMS,) - VC(S,)| (A 6) 

Sji'IO.O) " ' 

We thus have from Equation A 4 and A 6 

IK,h,(s.)-ic,,(s.)|< 

E Pj s WIMS,) - K.(S,)I. E 

Uj^(o,o) ’’ ' s,^{m " ■’ J 

(A 7) 


Let G 3^0 be the policy which chooses the control or u' for state 5, giving 
the maximum of right hand side of this equation Hence 

|Kn+l(^0-Kt+l(-^01< E P5 5 - W;)! (A 8) 

SjT^Co.o) •’ ' 

By repeatedly iterating this equation, we have 

|Ktn(5't) - Kt+i(^OI < E Proh[S{m) = 5, 1 S(0) = 5., ^n\Vo{S,) - ^(5,)! 

Sj?^(0,0) 

< Prob[S{m) ^ (0, 0) 1 5(0) = 5„ #"] max 1^0(5,) - 

(A 9) 

where G ^ takes actions according to policy for 0 < t < m 

By taking limits on both sides of this equation and applying Lemma A 1, 
we have 

hm |V;.«(S.) - VE,(S.)| = 0 (A 10) 

m —^00 

Since K:.n(50 = = C^*(S(0) = 5,) Hence 

hm V„+i(5,) = C^+(5(0) = 5») 

m -»oo W 


1 his piovcs the theorem 


□ 



Appendix B 

Probability of the Tagged Packet 
Delay 


Let us choose a packet (that arrived in the arriving epoch of length j) from 
the buffer of an active user, say a^, and tag it Let denote the number of 
packets in the buffer of the active user at at the beginning of the departing 
epoch Since is an active user, we have If cr is the arrival probability, 

then we have 


Probfb^* = m] = 


1 - (1 - a)y 


(BA) 


Let Pr[A:] denote the probability the tagged packet (TP) has a delay of k 
Then we have 

Pr[fc] = ^ Pr[fc 1 b^* = m] Prob[b‘^/ = m] (B 2) 

m=l 

where Pr[^ | = m] is the probability that the TP has a delay of k given that 

= m Now, Pr[fc | b^*' = m] can be written as 


Pr()t I b^* = m] = 

m 

E Prl‘ I = 771, TP IS rth packet] Prob[TP is rth packet in buffer | b^* - m] 

r 1 

(B3) 


But P;ob[TP IS rth packet in buffer j bf = Tn] = 1/m, hence we have 

•1 m 

PrfA I b"t = m] = —y?r[k \ b'f = m,TP is rth packet] (B 4) 
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We now illustrate how to evaluate | = m,TP is rth packet] 

For this let us assume k = j - I, t e , the tagged packet has a delay of j - I 
By considering all possibilities of arrival pattern in the arriving epoch, it can 
be seen that 


EPrl* = J-1| = m,TP IS rth packet] 

r ^ 1 



By substituting this value in Equation B 4, we get 


?r[k = m] 



Thus we have from Equation B 2 

Pr[k = J - 1] = 1 
3 


(B6) 


(B7) 


For other values of k also, it can be easily verified that 


Y,^v[k = j-1 I = m,TP IS rth packet] 

r=l 



(B8) 


Thus we have Pr[/r] = j for all values of k 
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